-- Logs begin at Thu 2022-06-16 16:40:38 UTC, end at Thu 2022-06-16 17:50:12 UTC. -- Jun 16 17:25:34.286030 dv-cinder-837546-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:25:34.294660 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:25:34 2022] *** Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: nodename: dv-cinder-837546-2-iscsi Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: machine: x86_64 Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: clock source: unix Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: pcre jit disabled Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: detected number of CPU cores: 4 Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: current working directory: / Jun 16 17:25:34.296547 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: your processes number limit is 47680 Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: your memory page size is 4096 bytes Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: detected max file descriptor number: 2048 Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: lock engine: pthread robust mutexes Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: thunder lock: enabled Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:25:34.297200 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:25:34.339563 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: Python main interpreter initialized at 0x55855b0d29c0 Jun 16 17:25:34.339563 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: python threads support enabled Jun 16 17:25:34.339563 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: your server socket listen backlog is limited to 100 connections Jun 16 17:25:34.339563 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:25:34.340086 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:25:34.340086 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: *** Operational MODE: preforking *** Jun 16 17:25:34.340305 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:25:34.340305 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: spawned uWSGI master process (pid: 103313) Jun 16 17:25:34.340451 dv-cinder-837546-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:25:34.343641 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: spawned uWSGI worker 1 (pid: 103314, cores: 1) Jun 16 17:25:34.343641 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: spawned uWSGI worker 2 (pid: 103315, cores: 1) Jun 16 17:25:34.343641 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:25:35.009956 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:25:35.013269 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:25:36.193559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:25:36.193559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes Jun 16 17:25:36.194175 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:25:36.194175 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes Jun 16 17:25:36.195620 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:25:36.195620 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: from cryptography.utils import int_from_bytes Jun 16 17:25:36.196062 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:25:36.196062 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: from cryptography.utils import int_from_bytes Jun 16 17:25:38.767656 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:25:38.768357 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:25:38.768464 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:25:38.768766 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:25:38.769019 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:25:38.769225 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:25:38.769631 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.769727 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:25:38.769842 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.770014 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:25:38.770167 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.770344 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.770491 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:25:38.770668 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.770774 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:25:38.770977 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771121 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771296 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771450 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771612 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771772 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.771935 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772091 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772188 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772422 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772518 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772733 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.772824 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-2-iscsi {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773055 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773187 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773405 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773508 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773733 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773830 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.773994 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774096 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774308 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774408 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774634 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-2-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774730 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.774956 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.775063 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.775265 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.775450 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.775562 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.775885 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776001 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776187 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776287 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776493 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776593 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776798 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.776902 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777124 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777325 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777471 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777624 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777805 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.777931 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.778056 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.778317 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.778428 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.778958 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779051 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779130 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779208 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-2-iscsi {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779284 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779380 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779591 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779736 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779853 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.779943 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780116 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780338 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780447 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780641 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780810 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-2-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.780946 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781127 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781311 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781477 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781604 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781768 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.781908 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782184 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782281 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782498 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782594 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782809 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.782900 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.783150 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.783253 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.783574 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.783683 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.783923 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784029 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784191 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784288 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784510 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784611 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784812 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.784902 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785115 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785256 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785388 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785486 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785693 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.785790 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786012 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786114 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786329 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786427 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786647 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786747 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.786895 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787001 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787163 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787294 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787465 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787557 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787782 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.787874 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788087 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788182 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788391 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788491 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788652 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788751 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788906 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.788996 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789253 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789360 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789577 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789677 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789879 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.789975 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790182 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790299 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790490 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790598 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790798 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.790894 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791105 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791215 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791408 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791513 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791710 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.791799 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792019 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792115 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792337 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792432 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792640 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792728 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.792958 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793055 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793288 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793390 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793605 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793700 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.793921 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794017 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794237 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794331 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794540 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794628 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794846 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.794943 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795150 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795245 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795464 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795563 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795779 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.795867 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796077 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796165 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796324 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796426 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796620 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796710 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.796920 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797009 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797256 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797362 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797565 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797661 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797868 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.797963 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.798152 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.798251 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.798451 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.798539 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.799265 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.799436 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.799919 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800020 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800110 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800193 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800274 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800355 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800587 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800697 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800812 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.800902 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801118 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801285 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801429 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801526 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801739 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.801839 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802044 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802134 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802350 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802439 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802653 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802749 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.802958 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803058 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803260 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803347 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803559 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803749 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.803857 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804005 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804155 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804290 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804450 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804556 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804766 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.804865 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805068 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805394 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805494 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805706 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.805809 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806011 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806099 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806311 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806406 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806624 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806725 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.806920 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807016 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807223 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807364 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807537 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807638 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807838 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.807935 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808139 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808235 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808438 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808541 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808738 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.808826 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809035 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809131 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809362 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809466 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809663 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809760 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.809964 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810064 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810259 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810360 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810560 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810654 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810867 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.810957 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811167 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811253 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811469 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811552 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811804 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.811893 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.812062 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.812183 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.812464 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.812601 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.812692 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.812781 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.812998 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.813096 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.813330 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.813420 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.813637 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.813741 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.813957 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:25:38.814047 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.814280 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.814368 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.815218 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.815770 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.815868 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.815951 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816031 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816111 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816199 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816294 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816418 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816510 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816725 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.816822 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817040 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817130 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817378 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817529 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817706 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.817797 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818020 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818111 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818334 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818447 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818646 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818744 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.818951 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819049 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819265 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819354 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819590 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819686 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819906 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.819995 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820208 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820304 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820527 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820616 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820858 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.820993 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821192 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821287 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821505 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821607 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821819 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.821974 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822126 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822215 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822431 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822519 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822739 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.822828 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823056 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823145 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823384 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823482 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823692 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.823781 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824006 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824105 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824311 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824412 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824618 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824707 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.824925 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825014 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825256 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825430 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825565 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825655 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825889 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.825978 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826197 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826296 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826507 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826596 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826811 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.826899 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827122 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827211 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827431 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827526 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827737 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.827834 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828044 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828142 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828345 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828441 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828644 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828746 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.828945 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829043 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829273 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829366 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829577 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829890 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.829986 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.830256 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.830781 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.830781 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.830958 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.830958 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831179 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831342 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831431 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831627 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831747 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.831937 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832065 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832247 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832367 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832552 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832702 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832867 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.832994 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833194 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833335 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833502 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833649 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833823 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.833960 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834131 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834266 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834434 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834580 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834756 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.834892 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835059 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835198 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835362 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835521 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835674 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835834 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.835984 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836142 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836293 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836467 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836600 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836774 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.836908 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837081 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837250 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837422 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837568 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837739 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.837947 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838086 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838239 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838385 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838521 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838833 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.838968 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839118 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839266 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839405 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839547 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839691 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.839883 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840032 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840217 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840359 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840527 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840673 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.840856 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841081 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841340 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841441 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841535 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841626 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841757 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.841848 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842061 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842208 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842364 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842455 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842668 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842758 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.842972 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843081 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843418 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843585 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843685 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843886 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.843974 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844188 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844277 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844490 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844577 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844792 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.844880 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.845115 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.845267 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.845447 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.845537 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.845876 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846301 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846403 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846496 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846579 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846661 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846741 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846884 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.846984 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847201 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847323 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847511 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847659 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847822 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.847983 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848126 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848306 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848437 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848619 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848759 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.848938 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849070 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849421 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849596 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849731 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.849909 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850053 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850221 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850360 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850542 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850677 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850854 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.850981 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851175 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851303 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851489 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851621 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851812 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.851951 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852125 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852305 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852463 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852608 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852752 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.852890 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853056 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853205 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853392 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853517 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853725 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.853816 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854044 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854212 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854366 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854457 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854679 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854769 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.854993 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855091 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855304 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855393 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855616 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.855920 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856065 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856230 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856321 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856546 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856634 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856847 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.856946 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857174 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857268 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857486 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857575 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857809 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.857949 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858122 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858211 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858434 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858521 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858738 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.858827 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859049 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859137 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859359 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859447 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859669 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859759 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.859973 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860073 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860275 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860364 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860582 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860673 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860895 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.860984 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.861223 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.861837 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862097 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862506 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862581 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862649 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862717 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862841 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.862977 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863154 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863297 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863462 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863609 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863769 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.863919 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864083 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864227 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864409 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864542 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864720 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.864851 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865042 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865140 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865389 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865492 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865694 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865784 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.865998 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866089 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866319 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866421 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866629 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866717 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.866933 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867023 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867237 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867336 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867541 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867637 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867878 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.867965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868191 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868303 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868496 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868584 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868801 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.868888 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869108 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869213 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869446 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869552 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869763 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.869853 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870073 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870164 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870383 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870473 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870706 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.870793 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.871017 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.871106 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.871326 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.871417 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.871886 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872028 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872197 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872287 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872505 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872594 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872813 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.872914 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873122 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873286 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873458 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873548 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873767 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.873867 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874077 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874164 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874379 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874467 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874687 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874789 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.874998 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875093 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875313 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875571 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875668 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875904 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.875994 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.876214 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.876301 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.876531 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.876619 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.876849 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.877670 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.877781 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.877866 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.877961 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878055 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878126 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878194 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878274 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878427 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878530 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878748 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.878852 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879079 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879176 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879408 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879497 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879721 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.879840 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880027 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880202 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880332 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880421 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880633 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880730 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.880937 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881026 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881258 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881349 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881563 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881664 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881865 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.881955 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882169 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882266 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882476 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882572 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882779 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.882869 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883085 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883175 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883382 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883469 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883683 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883779 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.883997 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884085 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884299 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884396 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884600 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884694 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884902 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.884998 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885250 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885361 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885552 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885640 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885854 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.885942 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886160 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886260 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886466 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886556 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886805 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.886893 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887109 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887200 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887431 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887521 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887734 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.887824 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888034 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888125 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888340 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888440 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888645 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888735 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.888949 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889040 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889270 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889377 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889580 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889670 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889880 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.889976 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890185 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890274 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890490 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890587 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890788 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.890875 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891094 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891182 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891392 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891493 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891698 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.891793 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.892001 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.892097 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.892300 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.892405 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.893261 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.893715 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.893810 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.893882 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.893954 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894050 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894143 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894225 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894312 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894396 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894616 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894707 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.894929 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895024 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895232 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895319 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895624 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895832 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.895920 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896136 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896223 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896437 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896527 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896735 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.896831 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897036 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897123 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897364 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897458 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897662 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897758 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.897964 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898062 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898263 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898409 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898562 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898651 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898862 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.898963 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899167 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899256 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899474 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899570 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899783 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.899881 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900080 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900169 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900380 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900476 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900679 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900776 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.900977 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901074 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901302 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901395 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901606 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901697 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901904 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.901993 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902203 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902331 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902501 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902599 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902801 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.902936 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903099 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903197 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903397 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903502 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903698 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903787 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.903994 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904081 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904292 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904381 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904589 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904677 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.904906 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905003 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905232 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905324 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905622 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905839 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.905949 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906141 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906239 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906481 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906576 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906780 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.906877 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907086 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907173 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907395 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907492 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907697 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.907865 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.908010 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.908100 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.908483 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.908962 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.908962 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909105 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909215 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909299 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909411 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909567 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909728 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.909887 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910042 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910199 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910358 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910507 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910664 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910824 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.910958 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911145 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911278 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911464 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911592 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911766 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.911903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912073 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912226 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912382 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912549 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912722 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912872 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.912993 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913197 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913309 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913512 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913655 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913829 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.913954 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914136 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914241 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914446 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914538 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914756 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.914847 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915067 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915171 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915379 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915470 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915683 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915780 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.915984 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916085 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916291 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916380 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916594 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916690 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916894 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.916985 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917219 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917325 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917522 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917630 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917828 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.917927 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.918204 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.918308 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.918430 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.918564 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.918804 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919005 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919093 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919174 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919440 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919652 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.919743 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920050 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920140 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920364 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920467 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920676 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920767 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.920979 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921067 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921312 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921422 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921626 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921717 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.921942 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922031 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922257 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922356 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922564 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922675 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922873 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.922963 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.923181 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.923281 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.923501 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.923593 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.924339 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.924503 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.924727 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.924833 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.925134 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.925285 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.925370 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.925685 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.925807 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926040 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926149 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926378 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926483 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926620 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.926977 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.927092 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.927704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.927814 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.927908 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.927996 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928088 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928178 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928322 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928413 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928631 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928736 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.928962 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929082 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929309 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929411 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929630 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929730 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.929933 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930024 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930247 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930338 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930556 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930668 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.930876 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931005 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931213 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931314 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931525 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931617 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931836 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.931934 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932139 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932231 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932461 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932552 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932778 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.932891 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933085 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933208 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933431 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933522 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933756 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.933853 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.934073 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.934172 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.934397 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.934520 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.934851 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935027 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935132 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935280 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935422 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935706 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.935844 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936000 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936133 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936284 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936424 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936571 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936708 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936852 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.936997 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937181 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937287 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937419 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937533 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937727 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.937858 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938032 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938165 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938332 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938479 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938638 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938793 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.938959 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939116 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939262 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939558 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939778 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939867 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.939938 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940160 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940270 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940405 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940559 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940730 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.940861 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941049 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941205 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941402 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941514 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941725 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.941833 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942031 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942131 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942355 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942454 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942766 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.942974 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943064 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943368 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943587 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943705 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.943933 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944037 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944234 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944331 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944556 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944647 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944875 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.944975 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945212 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945308 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945528 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945618 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945847 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.945945 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946149 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946247 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946450 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946541 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946757 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.946847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947060 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947149 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947361 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947452 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947662 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947752 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.947965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948131 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948263 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948353 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948562 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948659 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948864 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.948962 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949200 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949318 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949503 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949618 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949806 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.949915 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950112 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950211 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950411 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950509 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950710 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.950819 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951009 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951110 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951329 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951427 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951631 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951737 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.951933 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952031 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952236 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952343 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952562 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952868 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.952965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953209 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953311 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953533 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953634 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953849 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.953955 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954162 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954270 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954472 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954569 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954780 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.954897 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.955613 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.955730 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.955924 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956144 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956355 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956493 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956633 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956781 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.956939 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957081 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957249 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957343 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957454 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957864 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.957979 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.958183 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.958305 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.958731 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.958853 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.958945 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959069 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959212 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959372 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959521 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959709 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.959830 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960025 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960124 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960340 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960440 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960654 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960745 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.960970 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961105 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961308 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961414 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961622 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961721 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.961936 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962028 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962247 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962346 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962688 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.962960 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963181 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963280 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963492 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963589 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963829 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.963919 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964140 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964231 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964441 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964531 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964751 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.964850 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965061 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965195 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965397 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965489 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965707 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.965807 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966015 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966114 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966326 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966472 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966636 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966729 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.966946 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967037 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967255 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967352 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967563 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967653 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967872 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.967962 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968185 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968282 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968498 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968601 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968810 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.968904 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969124 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969259 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969458 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969550 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969771 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.969869 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.970106 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.970284 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.970425 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.970595 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.970808 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.971076 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.971259 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.971400 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.971581 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.971712 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972027 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972118 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972343 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972443 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972666 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972765 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.972969 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973060 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973295 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973391 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973606 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973709 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.973912 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974010 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974213 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974304 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974530 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974620 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974836 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.974926 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975138 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975230 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975454 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975546 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975762 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.975862 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976082 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976292 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976383 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976639 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976738 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.976950 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.977043 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.977296 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.977407 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.977617 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.977841 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978021 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978191 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978283 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978506 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978596 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978815 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.978912 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979127 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979217 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979437 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979529 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979746 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.979841 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980049 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980140 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980352 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980443 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980656 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980745 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.980960 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981049 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981289 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981432 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981594 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981688 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981895 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.981986 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982202 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982292 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982511 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982648 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982813 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.982902 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983112 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983214 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983414 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983503 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983713 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.983802 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984012 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984117 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984314 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984405 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984614 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984706 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.984919 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985019 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985243 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985338 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985549 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985641 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985847 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.985946 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.986149 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.986731 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987005 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987154 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987311 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987393 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987622 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987784 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.987927 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988111 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988239 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988417 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988544 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988721 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.988854 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989038 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989231 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989379 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989559 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989699 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.989870 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990010 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990178 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990320 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990495 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990661 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990806 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.990974 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.991130 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.991441 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.991530 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.991754 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.991844 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992100 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992192 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992416 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992506 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992764 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.992948 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993071 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993305 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993399 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993625 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993724 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.993961 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994065 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994293 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994384 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994600 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994699 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994904 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.994994 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995210 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995300 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995516 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995610 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995823 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.995916 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.996130 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.996229 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.996438 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.996528 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997067 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997197 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997331 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997412 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997639 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997732 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.997945 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.998033 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.998397 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.998675 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999011 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999266 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999368 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999590 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999681 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999909 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:38.999999 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000231 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000324 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000539 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000629 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000847 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.000946 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001199 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001296 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001488 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001579 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001802 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.001941 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002198 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002301 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002517 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002610 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002857 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.002965 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003142 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003232 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003456 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003559 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003771 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.003871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004084 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004175 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004403 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004494 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004736 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.004836 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005050 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005140 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005384 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005517 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005707 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.005801 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006016 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006113 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006342 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006441 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006678 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.006777 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007006 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007154 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007327 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007442 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007632 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007742 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.007933 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008025 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008235 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008412 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008542 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008645 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008858 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.008949 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009195 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009309 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009489 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009580 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009789 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.009882 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010095 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010189 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010397 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010494 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010696 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010787 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.010998 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011100 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011297 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011389 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011601 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011701 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011899 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.011992 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012198 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012295 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012496 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012595 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012794 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.012893 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013094 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013198 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013417 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013520 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013719 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.013822 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014016 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014114 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014315 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014415 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014613 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014711 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.014914 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015005 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015210 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015308 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015510 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015648 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015813 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.015903 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016121 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016213 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016424 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016522 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016728 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.016819 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.017033 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.017132 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.017364 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.017475 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018261 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018366 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018508 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018589 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018846 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.018944 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019162 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019254 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019484 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019577 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019795 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.019886 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020119 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020237 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020426 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020518 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020746 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.020836 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021050 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021168 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021383 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021475 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021697 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.021786 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022015 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022118 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022318 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022409 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022628 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022725 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.022938 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023042 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023248 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023339 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023558 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023647 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023866 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.023957 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024191 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024280 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024497 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024586 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024802 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.024894 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025116 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025236 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025449 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025552 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025757 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.025858 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026069 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026159 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026379 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026477 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026698 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.026789 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027009 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027106 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027314 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027412 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027626 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027717 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.027938 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028039 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028256 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028373 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028569 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028670 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028886 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.028977 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029237 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029333 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029557 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029646 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029865 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.029956 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.030168 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.030292 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.030411 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:25:39.030518 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.030834 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.031153 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.031498 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.031826 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.032140 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.032452 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.032756 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:25:39.032999 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:25:39.091986 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO dbcounter [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Registered counter for database nova_api Jun 16 17:25:39.095472 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO dbcounter [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Registered counter for database nova_api Jun 16 17:25:39.112141 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.115522 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.120901 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writer thread running {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.124354 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writer thread running {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.184026 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.context [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62ae26bd-3c1e-469b-8e56-1cd9277abf92(cell1) {{(pid=103315) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:25:39.188147 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.190380 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.191178 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.193205 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.195177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO dbcounter [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Registered counter for database nova_cell0 Jun 16 17:25:39.195976 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.context [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62ae26bd-3c1e-469b-8e56-1cd9277abf92(cell1) {{(pid=103314) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:25:39.199046 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO dbcounter [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Registered counter for database nova_cell1 Jun 16 17:25:39.200156 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.201855 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.202646 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:25:39.204624 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:25:39.207628 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.207777 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO dbcounter [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Registered counter for database nova_cell0 Jun 16 17:25:39.209353 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.211746 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO dbcounter [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Registered counter for database nova_cell1 Jun 16 17:25:39.215140 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writer thread running {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.218875 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.222555 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.224541 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writer thread running {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.355549 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writer thread running {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.366674 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO dbcounter [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Registered counter for database nova_cell0 Jun 16 17:25:39.369914 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writer thread running {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.375019 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_db.sqlalchemy.engines [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.379683 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO dbcounter [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Registered counter for database nova_cell0 Jun 16 17:25:39.380186 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writer thread running {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.388455 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:25:39.393543 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writer thread running {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:25:39.725481 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:25:39.732554 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:25:39.734975 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:25:39.742381 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:25:40.074702 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:25:40.081232 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: WARNING keystonemiddleware.auth_token [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:25:40.082619 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:25:40.086647 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55855b0d29c0 pid: 103315 (default app) Jun 16 17:25:40.088465 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-f9792c7e-6b6f-40c1-bea9-1f39d44f1a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:25:40.088685 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:25:40.089886 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jun 16 17:25:40.090299 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Thu Jun 16 17:25:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:25:40.093760 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55855b0d29c0 pid: 103314 (default app) Jun 16 17:26:57.888515 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:57.889928 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002678 Jun 16 17:26:57.890403 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:26:57.907175 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_api:SELECT=3 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.907980 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_cell0:SELECT=3 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.908876 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_cell1:SELECT=3 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:57.909785 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:26:58.353128 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-6cfd5d57-ffa1-40cc-9282-9bc7226f7572 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:26:58.384866 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-6cfd5d57-ffa1-40cc-9282-9bc7226f7572 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487406 Jun 16 17:26:58.391746 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 17:26:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:00.654570 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:00.655571 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3a05565f-1395-4616-9641-1b3b16980947 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 16 17:27:00.655961 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:27:00.721880 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-09ccd7ab-acd1-491f-8d3a-8cebd4734ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "disk": 1}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:00.745224 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:27:00.745224 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: warnings.warn(msg) Jun 16 17:27:00.776431 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-09ccd7ab-acd1-491f-8d3a-8cebd4734ee4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114462 Jun 16 17:27:00.777194 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:00.790883 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_api:SELECT=3 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:00.791666 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_cell0:SELECT=3 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:00.793121 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_cell1:SELECT=3 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:00.794659 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:01.020147 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-8de4e8de-2f9e-4570-8d23-b6416362a067 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:01.022545 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:27:01.022545 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:27:01.082405 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-8de4e8de-2f9e-4570-8d23-b6416362a067 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296834 Jun 16 17:27:01.097333 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 17:27:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:03.305461 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-09ccd7ab-acd1-491f-8d3a-8cebd4734ee4 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:03.306484 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-09ccd7ab-acd1-491f-8d3a-8cebd4734ee4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 16 17:27:03.306887 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:03.421636 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-20524ecc-c26c-4ec0-b814-1eca6fd8c455 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "swap": 0, "disk": 5}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:03.439918 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:27:03.439918 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:27:03.460582 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-20524ecc-c26c-4ec0-b814-1eca6fd8c455 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146816 Jun 16 17:27:03.460914 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:03.473261 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-06a9885c-401c-487a-ad65-0571e467d58d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:03.474734 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:27:03.474734 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: warnings.warn(msg) Jun 16 17:27:03.509305 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-06a9885c-401c-487a-ad65-0571e467d58d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040078 Jun 16 17:27:03.510474 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 17:27:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:05.733287 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-20524ecc-c26c-4ec0-b814-1eca6fd8c455 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:05.734499 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-20524ecc-c26c-4ec0-b814-1eca6fd8c455 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Jun 16 17:27:05.735340 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:05.796744 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-33b8a357-161c-4d97-8cfc-17adef99d5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:05.815723 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-33b8a357-161c-4d97-8cfc-17adef99d5d9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074465 Jun 16 17:27:05.816570 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:27:05.830016 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-77b98dc1-9246-4a19-a050-4c8aab058277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:05.853561 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-77b98dc1-9246-4a19-a050-4c8aab058277 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027613 Jun 16 17:27:05.854445 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 17:27:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:08.073315 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-33b8a357-161c-4d97-8cfc-17adef99d5d9 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:08.074501 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-33b8a357-161c-4d97-8cfc-17adef99d5d9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 16 17:27:08.074900 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:08.135352 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-1fd0d648-28cd-4ed6-8e23-0a2ef70dd296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "swap": 0, "vcpus": 2}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:08.153059 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-1fd0d648-28cd-4ed6-8e23-0a2ef70dd296 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072355 Jun 16 17:27:08.153654 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:27:08.165280 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5fb28fe9-5688-44ed-9c0f-43627fd7472a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:08.189225 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-5fb28fe9-5688-44ed-9c0f-43627fd7472a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027543 Jun 16 17:27:08.189901 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 17:27:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:10.410892 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-1fd0d648-28cd-4ed6-8e23-0a2ef70dd296 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:10.412639 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-1fd0d648-28cd-4ed6-8e23-0a2ef70dd296 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Jun 16 17:27:10.413542 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:10.498873 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "ram": 4096}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:10.516952 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097155 Jun 16 17:27:10.517739 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:27:10.530060 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-ca38a492-dbd0-46a2-a9f4-52ae79aad791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:10.552613 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-ca38a492-dbd0-46a2-a9f4-52ae79aad791 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026770 Jun 16 17:27:10.553201 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jun 16 17:27:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:12.767178 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:12.768847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002587 Jun 16 17:27:12.769276 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:12.831446 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-7b595779-4176-4c7d-ae95-02fbd7ace56d admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:12.858380 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-7b595779-4176-4c7d-ae95-02fbd7ace56d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082971 Jun 16 17:27:12.875229 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 17:27:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:15.169485 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:15.170638 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7f4925f8-8d53-4c51-b119-6da428522461 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jun 16 17:27:15.171053 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:15.233265 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-a22d58f8-8bcb-4a07-b01f-2d25d1637c8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:15.256472 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-a22d58f8-8bcb-4a07-b01f-2d25d1637c8f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078934 Jun 16 17:27:15.257454 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:15.270153 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-bb3c45aa-d26b-4474-9d2d-38bc317180db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:15.293761 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-bb3c45aa-d26b-4474-9d2d-38bc317180db admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027345 Jun 16 17:27:15.294347 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 17:27:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:27:17.656481 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-a22d58f8-8bcb-4a07-b01f-2d25d1637c8f admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:17.657615 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-a22d58f8-8bcb-4a07-b01f-2d25d1637c8f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 16 17:27:17.658033 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:27:17.725677 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-975205de-4c7e-4f68-877f-9b81f887df50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "ram": 2048, "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:17.748443 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-975205de-4c7e-4f68-877f-9b81f887df50 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084083 Jun 16 17:27:17.749108 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:27:17.763696 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-0c80e5d1-9eba-4f39-8e15-54af41ac7748 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:17.790805 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-0c80e5d1-9eba-4f39-8e15-54af41ac7748 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031681 Jun 16 17:27:17.791304 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 17:27:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:20.126353 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-975205de-4c7e-4f68-877f-9b81f887df50 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:20.127377 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-975205de-4c7e-4f68-877f-9b81f887df50 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 17:27:20.127783 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:20.200119 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5768b55d-b260-41e7-93cc-ae65484d386e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:20.225057 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5768b55d-b260-41e7-93cc-ae65484d386e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.091017 Jun 16 17:27:20.226159 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:20.243285 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-15ab8ad2-da9f-4996-9b60-0356a3bb8def admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:20.269682 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-15ab8ad2-da9f-4996-9b60-0356a3bb8def admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032981 Jun 16 17:27:20.270269 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 17:27:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:22.456852 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5768b55d-b260-41e7-93cc-ae65484d386e admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:22.457882 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5768b55d-b260-41e7-93cc-ae65484d386e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 17:27:22.458372 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:22.519446 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-fc85c88b-fe47-46f0-8018-8a1b7d6d4bf9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "ram": 8192}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:22.538061 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-fc85c88b-fe47-46f0-8018-8a1b7d6d4bf9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073935 Jun 16 17:27:22.538637 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:27:22.551030 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5603e822-7287-46a3-a7cc-50962413c42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:22.573441 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5603e822-7287-46a3-a7cc-50962413c42d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025882 Jun 16 17:27:22.574095 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 17:27:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:24.773717 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-fc85c88b-fe47-46f0-8018-8a1b7d6d4bf9 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:24.774744 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-fc85c88b-fe47-46f0-8018-8a1b7d6d4bf9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 16 17:27:24.775143 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:24.837383 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "ram": 16384}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:24.859032 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077552 Jun 16 17:27:24.859859 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jun 16 17:27:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:24.873166 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2cf604ac-5f5b-4883-af59-c5ff2e846244 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:24.905027 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2cf604ac-5f5b-4883-af59-c5ff2e846244 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036518 Jun 16 17:27:24.905813 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jun 16 17:27:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:27:49.558933 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:49.560458 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jun 16 17:27:49.560938 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:49.571498 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:49.622716 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-986cc439-d5dc-40cb-930b-34a04af53f2b admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:49.640202 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-986cc439-d5dc-40cb-930b-34a04af53f2b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073283 Jun 16 17:27:49.640726 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 17:27:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:50.635575 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.636586 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-5d25a3e2-5259-4c08-b8cc-7465ace6f980 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 16 17:27:50.636980 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:50.833656 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2923ec7b-57b5-459c-9874-6676a31a072a admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.839247 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-2923ec7b-57b5-459c-9874-6676a31a072a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2923ec7b-57b5-459c-9874-6676a31a072a admin admin] Request method failure captured: Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept: application/json Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Connection: keep-alive Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Content-Length: 0 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Host: 10.222.0.40 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABiq2gWU9dHaLXAghIv7oLIm5QR9Vx1UZjPrbQaz-crsSlUVzUULwDIsT95QdiloMumb6-dKqo9aHF_6u6NxwueWQn_8PjqwqeUXXKxNiFSrHjCWO0Mql2zlojQ0FiKArahH4KjyXzr3QPjsRskLMwWphIhiLLMrEb8FXxE9vsB5i0h66Y Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Id: None Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Name: None Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Name: admin Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Role: admin,reader,member Jun 16 17:27:50.843348 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Roles: admin,reader,member Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant: admin Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User: admin Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Name: admin Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: method: > Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: exception: Flavor 42 could not be found. Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: action_args: {'id': '42'} Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:50.845176 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:50.846279 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.847438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2923ec7b-57b5-459c-9874-6676a31a072a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:50.848667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2923ec7b-57b5-459c-9874-6676a31a072a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069247 Jun 16 17:27:50.848667 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:50.854471 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-d5769d95-3ddf-489f-8abd-87796cef55cd admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.858553 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:27:50.879515 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-d5769d95-3ddf-489f-8abd-87796cef55cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028598 Jun 16 17:27:50.880080 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:50.890035 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0f04776f-7446-4a33-998c-b74b94e9fd44 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.911135 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0f04776f-7446-4a33-998c-b74b94e9fd44 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024741 Jun 16 17:27:50.911679 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:27:50.922607 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-16bfecef-8c38-481a-8df9-18788f1f56ff admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:50.928899 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-16bfecef-8c38-481a-8df9-18788f1f56ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-16bfecef-8c38-481a-8df9-18788f1f56ff admin admin] Request method failure captured: Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept: application/json Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Connection: keep-alive Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Content-Length: 0 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Host: 10.222.0.40 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABiq2gWU9dHaLXAghIv7oLIm5QR9Vx1UZjPrbQaz-crsSlUVzUULwDIsT95QdiloMumb6-dKqo9aHF_6u6NxwueWQn_8PjqwqeUXXKxNiFSrHjCWO0Mql2zlojQ0FiKArahH4KjyXzr3QPjsRskLMwWphIhiLLMrEb8FXxE9vsB5i0h66Y Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Id: None Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Name: None Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Name: admin Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Role: admin,reader,member Jun 16 17:27:50.932177 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Roles: admin,reader,member Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant: admin Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User: admin Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Name: admin Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: method: > Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: exception: Flavor 42 could not be found. Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: action_args: {'id': '42'} Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:50.933798 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:50.935456 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:50.936910 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-16bfecef-8c38-481a-8df9-18788f1f56ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:50.938321 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-16bfecef-8c38-481a-8df9-18788f1f56ff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016048 Jun 16 17:27:50.938321 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 17:27:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:51.821527 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0f04776f-7446-4a33-998c-b74b94e9fd44 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:51.822649 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0f04776f-7446-4a33-998c-b74b94e9fd44 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jun 16 17:27:51.823100 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:52.042161 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9bb1173c-9164-44f5-bdc2-8d193379fd46 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.048987 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-9bb1173c-9164-44f5-bdc2-8d193379fd46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9bb1173c-9164-44f5-bdc2-8d193379fd46 admin admin] Request method failure captured: Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept: application/json Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Connection: keep-alive Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Content-Length: 0 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Host: 10.222.0.40 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABiq2gXzEUkH0176Oh2Dbc2Fe93j4PxfWbGjat2DLJ2kWRCD1MVhP6SHGkbvu_MxA6UpN3gmzs0PwTZbFU70ZE7VTd1WSTsdH5Sq4SEYaPHlw4RS7NJl5g9At6FeUVgNt8cbJBm5z-z3tnFoEv1Ypk2SoIeXcmGF8H2WFqv_XQyt86NOJI Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Id: None Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Name: None Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Name: admin Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Role: admin,reader,member Jun 16 17:27:52.050523 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Roles: admin,reader,member Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant: admin Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User: admin Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Name: admin Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: method: > Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: exception: Flavor 84 could not be found. Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: action_args: {'id': '84'} Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:52.052085 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:52.052965 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.055310 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-9bb1173c-9164-44f5-bdc2-8d193379fd46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:52.056505 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-9bb1173c-9164-44f5-bdc2-8d193379fd46 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063145 Jun 16 17:27:52.056505 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 17:27:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:52.062496 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8741d64b-699f-4b60-b75b-8a84596a7b40 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.077952 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-8741d64b-699f-4b60-b75b-8a84596a7b40 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019540 Jun 16 17:27:52.078489 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:27:52.087966 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-01c7a097-fb04-4fe9-a29e-02c53e4f5307 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.104249 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-01c7a097-fb04-4fe9-a29e-02c53e4f5307 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019856 Jun 16 17:27:52.104776 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:52.115925 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a39fcffe-3a07-4bdb-a16a-c65f7be3d243 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:52.122832 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-a39fcffe-3a07-4bdb-a16a-c65f7be3d243 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a39fcffe-3a07-4bdb-a16a-c65f7be3d243 admin admin] Request method failure captured: Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept: application/json Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Connection: keep-alive Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Content-Length: 0 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Host: 10.222.0.40 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABiq2gXzEUkH0176Oh2Dbc2Fe93j4PxfWbGjat2DLJ2kWRCD1MVhP6SHGkbvu_MxA6UpN3gmzs0PwTZbFU70ZE7VTd1WSTsdH5Sq4SEYaPHlw4RS7NJl5g9At6FeUVgNt8cbJBm5z-z3tnFoEv1Ypk2SoIeXcmGF8H2WFqv_XQyt86NOJI Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Id: None Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Name: None Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Name: admin Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Role: admin,reader,member Jun 16 17:27:52.124704 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Roles: admin,reader,member Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant: admin Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User: admin Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Name: admin Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: method: > Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: exception: Flavor 84 could not be found. Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: action_args: {'id': '84'} Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:52.126262 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:52.127322 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:52.128603 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a39fcffe-3a07-4bdb-a16a-c65f7be3d243 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:52.129943 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a39fcffe-3a07-4bdb-a16a-c65f7be3d243 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014988 Jun 16 17:27:52.129943 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jun 16 17:27:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:53.016527 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-01c7a097-fb04-4fe9-a29e-02c53e4f5307 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.017725 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-01c7a097-fb04-4fe9-a29e-02c53e4f5307 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Jun 16 17:27:53.018153 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:53.208298 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-1b509d16-c038-45a0-81c0-a69fefb1a934 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.214964 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-1b509d16-c038-45a0-81c0-a69fefb1a934 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-1b509d16-c038-45a0-81c0-a69fefb1a934 admin admin] Request method failure captured: Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept: application/json Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Connection: keep-alive Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Content-Length: 0 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Host: 10.222.0.40 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABiq2gZedeGayXBsZunZlWj0GufAPOU9fBXAQBpJCTAZwwhG5dwtCq4MwOkfQFUYOqZEZuSGyDh_-sSwnUFKnmKqG_uzRdweJCVodf3KPWJtNud7a-JOKOJbZ9PBXWK7byRSvR2vMX-8sUonmkGjwyOVWodpKc80NvBqgjW_x-XFJid67I Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Id: None Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Domain-Name: None Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Project-Name: admin Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Role: admin,reader,member Jun 16 17:27:53.216903 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Roles: admin,reader,member Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant: admin Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User: admin Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: X-User-Name: admin Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: method: > Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: exception: Flavor 451 could not be found. Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: action_args: {'id': '451'} Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:53.220534 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:53.221627 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.222847 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-1b509d16-c038-45a0-81c0-a69fefb1a934 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:53.224021 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-1b509d16-c038-45a0-81c0-a69fefb1a934 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064358 Jun 16 17:27:53.224021 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:53.233299 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-cf808c3b-dd41-499c-b66b-f2889314baa9 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.253362 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-cf808c3b-dd41-499c-b66b-f2889314baa9 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026344 Jun 16 17:27:53.253920 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:53.263934 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.278134 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018126 Jun 16 17:27:53.279265 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:27:53.290113 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e0a12b98-0cf5-4552-a556-9b16134911a8 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:53.297307 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.wsgi [None req-e0a12b98-0cf5-4552-a556-9b16134911a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e0a12b98-0cf5-4552-a556-9b16134911a8 admin admin] Request method failure captured: Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept: application/json Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Accept-Encoding: gzip, deflate Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Connection: keep-alive Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Content-Length: 0 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Host: 10.222.0.40 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-Api-Version: compute 2.90 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Openstack-System-Scope: None Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: User-Agent: python-novaclient Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Auth-Token: gAAAAABiq2gZedeGayXBsZunZlWj0GufAPOU9fBXAQBpJCTAZwwhG5dwtCq4MwOkfQFUYOqZEZuSGyDh_-sSwnUFKnmKqG_uzRdweJCVodf3KPWJtNud7a-JOKOJbZ9PBXWK7byRSvR2vMX-8sUonmkGjwyOVWodpKc80NvBqgjW_x-XFJid67I Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Id: None Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Domain-Name: None Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Identity-Status: Confirmed Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Is-Admin-Project: True Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Id: default Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Domain-Name: Default Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Project-Name: admin Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Role: admin,reader,member Jun 16 17:27:53.299157 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Roles: admin,reader,member Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26ada52fc9b44bcbbe7f2cc5f37ab303", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26ada52fc9b44bcbbe7f2cc5f37ab303"}]}] Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant: admin Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Id: 26ada52fc9b44bcbbe7f2cc5f37ab303 Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-Tenant-Name: admin Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User: admin Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Id: default Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Domain-Name: Default Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Id: eac0995e068547e3890aa6066bdecd84 Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: X-User-Name: admin Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: method: > Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: exception: Flavor 451 could not be found. Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: action_args: {'id': '451'} Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:27:53.300719 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:53.301573 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: ERROR nova.api.openstack.wsgi Jun 16 17:27:53.302871 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-e0a12b98-0cf5-4552-a556-9b16134911a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:27:53.304121 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-e0a12b98-0cf5-4552-a556-9b16134911a8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015321 Jun 16 17:27:53.304121 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:27:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:27:54.175213 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:54.176248 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 17:27:54.176661 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:54.390300 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-0ad2b1a0-ea07-47be-9872-6553d946c3e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:54.408158 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-0ad2b1a0-ea07-47be-9872-6553d946c3e5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072392 Jun 16 17:27:54.408697 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 17:27:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:55.291347 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:55.292485 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 16 17:27:55.292886 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:55.485657 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-c9978796-880e-446e-aa30-cb343f4f5cd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:55.503726 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-c9978796-880e-446e-aa30-cb343f4f5cd0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071370 Jun 16 17:27:55.504267 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 17:27:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:56.378721 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:56.379716 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 16 17:27:56.380101 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:56.571498 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-dc7bd382-18bc-4d89-9f9a-a0eb40ca0f90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:56.589500 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-dc7bd382-18bc-4d89-9f9a-a0eb40ca0f90 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070641 Jun 16 17:27:56.590049 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 17:27:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:57.459940 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:57.460940 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 16 17:27:57.461438 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:57.657769 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-67db5449-ab88-4c68-8411-9852cbb83a20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:27:57.677285 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-67db5449-ab88-4c68-8411-9852cbb83a20 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079406 Jun 16 17:27:57.677830 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jun 16 17:27:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:27:58.546829 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:58.547908 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 16 17:27:58.548421 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:27:58.744396 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-fca27fdb-910f-4d34-ba26-9a1f486af7fe admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:27:58.764203 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-fca27fdb-910f-4d34-ba26-9a1f486af7fe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071803 Jun 16 17:27:58.764674 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Thu Jun 16 17:27:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:47.233597 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.234763 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-7935e042-1221-4a97-9a83-203d26932277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 16 17:28:47.235325 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:28:47.246971 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:47.297750 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-3a2546e8-a7f3-49f8-b596-cded89256c12 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.317501 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-3a2546e8-a7f3-49f8-b596-cded89256c12 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076228 Jun 16 17:28:47.318038 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:28:47.342027 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-835ca8e8-ae9f-4bce-8d50-8d175a7f36a8 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.345532 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG dbcounter [-] [103314] Writing DB stats nova_api:SELECT=14 {{(pid=103314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:28:47.351269 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-835ca8e8-ae9f-4bce-8d50-8d175a7f36a8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012939 Jun 16 17:28:47.351799 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:47.363360 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-b1eb0bb0-61f5-4dfb-8bab-886362009ffb admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.371440 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-b1eb0bb0-61f5-4dfb-8bab-886362009ffb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011434 Jun 16 17:28:47.371959 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:47.383703 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.392144 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012026 Jun 16 17:28:47.393187 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:28:47.404696 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-1dc23f46-9c3b-4427-8466-97f12d941bda admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:28:47.413313 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-1dc23f46-9c3b-4427-8466-97f12d941bda admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012152 Jun 16 17:28:47.413841 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jun 16 17:28:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:32:11.702480 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:11.703512 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 16 17:32:11.703904 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:11.862810 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_api:SELECT=6 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:11.984390 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:11.985604 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:32:11.985604 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:32:11.987663 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:11.988101 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:11.988908 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:11.989370 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:12.023839 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-689c9c2f-a123-40e3-81e6-8c74fa9d34ec admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163500 Jun 16 17:32:12.024393 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:32:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:32:12.901651 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:12.902658 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 17:32:12.903056 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:32:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:13.100602 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:13.101833 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:32:13.101833 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:32:13.103034 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:13.103472 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:13.104279 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:13.104701 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:13.125468 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-060269c8-2ec0-4742-9d75-657d5d900d4a admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080557 Jun 16 17:32:13.126028 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:32:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:32:24.430871 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:24.431862 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 16 17:32:24.432246 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:24.577166 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_cell0:SELECT=4 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:24.577891 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_cell1:SELECT=4 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:24.578494 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG dbcounter [-] [103315] Writing DB stats nova_api:SELECT=8 {{(pid=103315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:32:24.628405 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:24.629659 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:32:24.629659 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:32:24.630821 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:24.631253 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:24.632023 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:24.632462 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:24.657232 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-371a0b5a-a284-4e34-b086-25d853c3380e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084443 Jun 16 17:32:24.657770 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:32:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:32:25.535844 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:25.536856 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-2feb2e07-a703-40c9-8c8e-e23bc156df71 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 16 17:32:25.537317 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jun 16 17:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:32:25.741168 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG nova.api.openstack.wsgi [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] Calling method '>' {{(pid=103315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:32:25.742406 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:32:25.742406 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: warnings.warn(msg) Jun 16 17:32:25.743589 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:25.744055 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:25.744835 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:32:25.745343 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: DEBUG oslo_concurrency.lockutils [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:32:25.767959 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: INFO nova.api.openstack.requestlog [None req-eea7aa3c-51bb-4461-9fbf-b1e2b47d5d81 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079805 Jun 16 17:32:25.769068 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: [pid: 103315|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jun 16 17:32:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:33:22.705994 dv-cinder-837546-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 17:33:22.706531 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: Thu Jun 16 17:33:22 2022 - graceful shutdown triggered... Jun 16 17:33:22.706970 dv-cinder-837546-2-iscsi devstack@n-api.service[103314]: Gracefully killing worker 1 (pid: 103314)... Jun 16 17:33:22.707334 dv-cinder-837546-2-iscsi devstack@n-api.service[103315]: Gracefully killing worker 2 (pid: 103315)... Jun 16 17:33:23.707454 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: worker 1 buried after 1 seconds Jun 16 17:33:23.708028 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: worker 2 buried after 1 seconds Jun 16 17:33:23.708028 dv-cinder-837546-2-iscsi devstack@n-api.service[103313]: goodbye to uWSGI. Jun 16 17:33:23.709105 dv-cinder-837546-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 17:33:23.709690 dv-cinder-837546-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 17:33:23.712512 dv-cinder-837546-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:33:23.721923 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:33:23 2022] *** Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: nodename: dv-cinder-837546-2-iscsi Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: machine: x86_64 Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: clock source: unix Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: pcre jit disabled Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: detected number of CPU cores: 4 Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: current working directory: / Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: your processes number limit is 47680 Jun 16 17:33:23.724314 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: your memory page size is 4096 bytes Jun 16 17:33:23.725788 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: detected max file descriptor number: 2048 Jun 16 17:33:23.725788 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: lock engine: pthread robust mutexes Jun 16 17:33:23.725788 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: thunder lock: enabled Jun 16 17:33:23.725788 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:33:23.725788 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:33:23.770233 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: Python main interpreter initialized at 0x558efbf499c0 Jun 16 17:33:23.770233 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: python threads support enabled Jun 16 17:33:23.770233 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: your server socket listen backlog is limited to 100 connections Jun 16 17:33:23.770233 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:33:23.770746 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:33:23.770746 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: *** Operational MODE: preforking *** Jun 16 17:33:23.770974 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:33:23.770974 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: spawned uWSGI master process (pid: 124148) Jun 16 17:33:23.771182 dv-cinder-837546-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:33:23.771787 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: spawned uWSGI worker 1 (pid: 124160, cores: 1) Jun 16 17:33:23.772303 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: spawned uWSGI worker 2 (pid: 124161, cores: 1) Jun 16 17:33:23.772581 dv-cinder-837546-2-iscsi devstack@n-api.service[124148]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:33:24.445218 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:33:24.477134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:33:25.711053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:33:25.711053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: from cryptography.utils import int_from_bytes Jun 16 17:33:25.711708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:33:25.711708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: from cryptography.utils import int_from_bytes Jun 16 17:33:25.741500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:33:25.741500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: from cryptography.utils import int_from_bytes Jun 16 17:33:25.742130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:33:25.742130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: from cryptography.utils import int_from_bytes Jun 16 17:33:28.140562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:33:28.141114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:33:28.141370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:33:28.141645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:33:28.141919 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:33:28.142311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.142630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.142952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.143461 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.143958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.144430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.144935 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.145480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.145982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.146260 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.147044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.147044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-2-iscsi {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.147243 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.147535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.148424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.148424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.148599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.148794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.149108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.149645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-2-iscsi {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.154930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.156030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.156294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.156629 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.156959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.157324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.157668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.157993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.158347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.158681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.159014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.159348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.159661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.159977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.160296 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.160624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.161639 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.161966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.162227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.162546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.162878 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.163209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.163538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.163797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.164051 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.164375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.164702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.165017 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.165358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.165671 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.165982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.166294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.166615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.166935 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.167231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.167563 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.168485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.168485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.168485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.168921 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.169210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.169457 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.169768 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.170175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.170441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.170754 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.171078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.171401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.171711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.172022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.172331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.172738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.172996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.173336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.173590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.173896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.174204 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.174526 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.174834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.175146 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.175500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.175757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.176065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.176560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.177331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.177617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.178114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.178582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.179058 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.179537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.180010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.180492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.180986 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.181466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.181951 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.182432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.182913 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.183405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.183892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.184357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.184838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.185340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.185829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.186313 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.186798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.187315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.187838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.188343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.188849 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.189390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.189905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.190409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.190914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.191413 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.191919 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.192989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.193519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.194023 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.194532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.195048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.195571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.196085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.196599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.197676 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.198209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.198766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.199294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.199841 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.200359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.200902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.201473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.201987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.202491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.203019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.203560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.204076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.204574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.205077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.205627 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.206148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.206686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.207214 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.207332 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:33:28.208440 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:33:28.208579 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:33:28.209053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.209331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:33:28.209545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.209899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:33:28.210027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.210398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.210711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.210878 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.211343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.211468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.211856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.212090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.212342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.212482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.212752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.213075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.213263 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.213449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.213585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.213754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.213877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.214168 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.214358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.214525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.214633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.214814 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.214916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.215135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.215236 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-2-iscsi {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.215470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.215581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.215813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.215921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.216134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.216244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.216461 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.216575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.216780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.216949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.217098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.217289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.217449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.217595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.217749 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.217916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.218095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.218254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.218411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.218566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.218736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.218885 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.219037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.219199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.219354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.219510 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.219666 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.219813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.219959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.220141 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.220298 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.220445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.220606 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.220775 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.220929 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.221229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.221396 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.221553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-2-iscsi {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.221701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.221848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.222010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.222158 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.222320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.222469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.222625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.222784 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.222949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.223104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.223804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.224025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.224201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.224363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.224531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.224687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.224841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.224990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.225142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.225367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.225535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.225693 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.225841 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.225994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.226142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.226363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.226522 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.226671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.226817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.226971 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.227126 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.227281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.227428 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.227591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.227738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.227885 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.228039 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.228193 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.228340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.228494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.228648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.228796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.228955 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.229103 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.229864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.230017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.230187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.230713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.231109 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.232118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.232281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.232431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.235540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.235717 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.235892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.236059 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.236222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.238705 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.239550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.239713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.239713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.240011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.240011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.240011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.240011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.240607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.240755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.240908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.241055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.241285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.241445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.241592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.241739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.241891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.242038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.242303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.242468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.242623 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.242770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.242917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.243071 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.243232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.243391 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.243538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.243538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.243538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.243538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.244112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.244641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.244807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.244956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.245268 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.245441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.245591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.245826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.246054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.246278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.246511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.246745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.246975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.247197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.247433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.247639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.247849 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.248107 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.248336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.248555 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.249068 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.249417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.249677 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.249926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.249926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.250411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.250635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.250834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.250834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.251222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.251494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.251739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.251932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.252094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.252269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.252515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.252683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.252841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.252998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.253174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.253343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.253506 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.253661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.253810 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.253964 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.254120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.254120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.254431 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.255112 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.255303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.255464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.255611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.255758 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.255918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.256073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.256231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.256386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.256541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.256689 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.256858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.257014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.257180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.257334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.257481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.257639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.257788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.257942 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.258089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.258249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.258395 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.258540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.258693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.258858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.259019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.259168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.259329 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.259484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.259630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.259776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.259931 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.260085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.260280 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.260431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.260585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.260732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.260901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.261049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.261357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.261513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.261660 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.261806 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.261960 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.262115 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.262281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.262456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.262710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.262877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.263043 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.263192 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.263339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.263484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.263630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.263854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.264016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.264164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.264357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.264516 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.264663 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.264834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.264988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.265171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.265171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.265459 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.265617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.265778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.265925 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.266070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.266215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.266367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.266523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.266670 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.266815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:33:28.266968 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267133 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.267899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268353 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.268959 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269462 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.269925 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.270120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.270952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271152 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.271956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.272111 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.272259 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.272414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.272631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.272899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273379 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273688 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.273844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.274076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.274296 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.274449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.274604 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.274772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275017 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275260 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.275931 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276079 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276079 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.276852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277288 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277604 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.277913 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278062 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278207 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278364 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.278985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279133 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.279928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280395 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.280871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281017 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281183 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281183 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281628 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.281928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282073 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282389 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282536 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282679 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.282826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283529 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283676 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.283821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.284255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.284419 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.284576 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.284733 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.284880 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.285025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.285025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.285025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.285612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.285804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.286945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287402 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287712 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.287867 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288306 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288772 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.288928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.289872 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290327 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290492 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290805 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.290952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291112 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291259 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291405 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.291861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292628 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.292866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.293928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294376 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294701 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.294856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295156 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295458 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.295926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296072 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296542 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.296969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297599 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297751 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.297907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298688 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298835 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.298988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299299 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299600 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.299891 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300192 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300655 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.300956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301775 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.301934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.302852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.303877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304495 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.304986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.305914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306214 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.306862 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.307975 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308127 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.308924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.309932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310723 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.310876 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311356 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311671 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.311998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312635 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.312958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.313292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.313447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.313701 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.313872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314344 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314843 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.314998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315150 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.315924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.316873 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.317581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.317746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.317896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318091 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318533 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318679 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.318993 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319147 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.319948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.320871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321195 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321673 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.321990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.322138 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.322290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.322559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.322721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.322879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323175 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.323897 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324058 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324809 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.324966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.325114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.325332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.325491 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.325735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.325888 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326047 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326806 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.326958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.327133 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.327133 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328180 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328503 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328800 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.328955 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329100 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329273 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.329894 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330653 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.330957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331988 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.331988 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.332287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.332441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.332608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.332608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.333477 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.333624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.333850 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334480 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.334946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335251 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335404 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.335875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336163 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336462 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336608 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.336917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337388 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337542 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.337991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.338970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.339939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340380 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340709 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.340977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341109 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.341941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342133 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.342986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343082 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.343888 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344409 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.344925 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345099 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345204 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345403 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345762 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.345943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346126 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346212 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346692 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.346780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.347873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348664 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.348965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349239 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349541 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.349940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350181 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350651 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.350940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351508 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.351970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352478 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352837 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.352922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353557 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.353945 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354655 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354843 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.354939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355130 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355680 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355769 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.355948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356035 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356129 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356684 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.356872 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357116 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357459 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357549 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357642 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.357913 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358193 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358763 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.358958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359470 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359897 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.359984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360071 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360157 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360759 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360891 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.360997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361196 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361593 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361682 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.361969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362255 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362342 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362471 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362666 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362929 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.362929 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.363095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.363247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.363346 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.363435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.363558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.364379 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.364626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.364834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365003 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365616 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.365930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366035 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366602 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.366914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.367863 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368332 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368810 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.368945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.369281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.369439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.369609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.369709 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.369917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.370994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371157 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.371986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372183 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.372915 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.373112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.373299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.373530 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.373662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374427 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.374842 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375147 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375452 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375663 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.375980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.376907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377645 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.377961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378160 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.378883 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.379091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.379235 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.379397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.380248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.380410 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.380683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.381489 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.381625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.381757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.381900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382163 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382438 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382718 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.382992 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.383970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.384792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385379 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.385937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.386954 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387052 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387150 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387478 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387566 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387663 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.387957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388508 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.388867 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.389822 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390491 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.390965 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391078 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391593 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391690 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.391934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392043 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392242 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392860 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.392964 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393183 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393498 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393641 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.393918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394109 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394414 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.394859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395232 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.395920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396088 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396508 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396726 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.396824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397122 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397382 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.397792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398760 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.398976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399709 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.399927 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400242 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400427 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400666 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.400953 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401184 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.401929 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402223 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402732 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.402832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403213 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403750 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.403931 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.404998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.405851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406057 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406154 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406465 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406669 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.406971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407373 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.407991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408857 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.408959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409196 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409624 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.409931 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.410144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.410247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.410455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.410558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.410828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411156 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411727 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.411823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412458 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.412989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413437 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.413959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414282 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414388 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414704 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.414918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415053 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415337 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415551 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.415966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.416187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.416393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.416492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.416716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.416812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417224 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.417977 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418073 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418300 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418442 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.418953 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419057 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419362 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.419996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420202 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420306 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420511 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420642 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.420958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421277 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421807 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.421904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.422121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.422225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.422462 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.422660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.422758 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.423001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:33:28.423105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.423319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.423649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.423978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.424297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.424607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.424933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.425267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.425575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.425893 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.426207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.427042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.427349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.427668 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.427977 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.428284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.428596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.428903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.429261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.429572 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.429879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.430186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.430499 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.430807 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.431114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.431420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.431725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.432038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.432342 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.432654 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.432960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.433299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.433606 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.433915 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.434266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.434591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.434899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.435205 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.435521 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.435829 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.436152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.436464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.436771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.437123 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.437471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.438013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.438350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.438673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.439007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.439343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.439652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.439957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.440262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.440587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.440898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.441236 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.441558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.441870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.442761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.443072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.443384 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.443694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.444005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.444315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.444733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.444931 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.445279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.445582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.445923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.446815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.446815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.447013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.447168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.447489 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.447803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.448117 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.448431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.448751 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.449083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.449444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.449754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.450181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.450494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.450815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.451138 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.451449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.451772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.452097 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.452410 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.452730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.453043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.453399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.453741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.454072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.454399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.454706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.455010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.455316 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.455627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.455943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.456254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.456557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.456859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.457201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.457513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.458176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.458493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.458801 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.459114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.459419 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.459726 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.460030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.460334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.460639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.460944 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.461279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.461586 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.461890 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.462195 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.462500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.462803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.463135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.463469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.463787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.464113 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.464426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.464749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.465061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.465418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.465747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.466063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.466374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.466711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.467024 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.467340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.467653 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.467965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.468277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.468589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.468919 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.469272 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.469581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.469910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.470230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.470550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.470867 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.471181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.471515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.471829 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.472139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.472458 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.472770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.473083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.473631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.474042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.474381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.474717 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.475032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.475363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.475698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.476053 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.476370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.476716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.477050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.477398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.477711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.478018 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:33:28.478266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:33:28.486890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO dbcounter [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Registered counter for database nova_api Jun 16 17:33:28.508026 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_db.sqlalchemy.engines [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.514922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writer thread running {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.543105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO dbcounter [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Registered counter for database nova_api Jun 16 17:33:28.563107 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_db.sqlalchemy.engines [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.570740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writer thread running {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.572339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.context [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62ae26bd-3c1e-469b-8e56-1cd9277abf92(cell1) {{(pid=124161) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:33:28.576507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:28.578129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:28.578946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:28.580910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:28.582963 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO dbcounter [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Registered counter for database nova_cell0 Jun 16 17:33:28.587011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO dbcounter [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Registered counter for database nova_cell1 Jun 16 17:33:28.594436 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_db.sqlalchemy.engines [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.596236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_db.sqlalchemy.engines [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.602560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writer thread running {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.603835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writer thread running {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.628903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.context [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62ae26bd-3c1e-469b-8e56-1cd9277abf92(cell1) {{(pid=124160) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:33:28.634130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:28.635725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:28.636550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:33:28.638568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:33:28.640575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO dbcounter [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Registered counter for database nova_cell0 Jun 16 17:33:28.644580 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO dbcounter [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Registered counter for database nova_cell1 Jun 16 17:33:28.652237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_db.sqlalchemy.engines [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.654756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_db.sqlalchemy.engines [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.662057 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writer thread running {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.663730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writer thread running {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.755294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO dbcounter [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Registered counter for database nova_cell0 Jun 16 17:33:28.763982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_db.sqlalchemy.engines [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.768541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writer thread running {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:28.814767 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO dbcounter [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Registered counter for database nova_cell0 Jun 16 17:33:28.822204 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_db.sqlalchemy.engines [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:33:28.826896 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writer thread running {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:33:29.099223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: WARNING keystonemiddleware.auth_token [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:33:29.106541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: WARNING keystonemiddleware.auth_token [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:33:29.165501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: WARNING keystonemiddleware.auth_token [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:33:29.172965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: WARNING keystonemiddleware.auth_token [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:33:29.476107 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: WARNING keystonemiddleware.auth_token [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:33:29.482155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: WARNING keystonemiddleware.auth_token [None req-20964390-87e7-47dd-969f-dfaadebdc5f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:33:29.487702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558efbf499c0 pid: 124161 (default app) Jun 16 17:33:29.532802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: WARNING keystonemiddleware.auth_token [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:33:29.539427 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: WARNING keystonemiddleware.auth_token [None req-b2577b37-7c04-4537-aa56-ae5a4f3e6be4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:33:29.544689 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558efbf499c0 pid: 124160 (default app) Jun 16 17:34:09.096518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:09.097934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:09.099171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:09.100340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:10.239689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cf3e555b-efb2-45c0-9eec-3f00e4aff44c tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Action: 'create', calling method: .version_select at 0x7f84ac375790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-270423796", "metadata": {"Type": "work"}}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:11.767648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f217c50a-b748-4997-9d01-067cbc559981 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84acd7e9d0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:11.825141 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:11.833925 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:11.837203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:11.839467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:12.606571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cf3e555b-efb2-45c0-9eec-3f00e4aff44c tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.526424 Jun 16 17:34:12.607576 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 17:34:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3529 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:34:12.619938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f551b440-ed58-44d1-b6c6-3df28f8b0e0f tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Calling method '.version_select at 0x7f84ac23f5e0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:12.783957 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f551b440-ed58-44d1-b6c6-3df28f8b0e0f tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689" status: 200 len: 353 microversion: 2.1 time: 0.168026 Jun 16 17:34:12.786755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:12 2022] GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:12.797687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f217c50a-b748-4997-9d01-067cbc559981 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/7248f5b3-0a27-4408-be8a-566db81c64bb" status: 200 len: 351 microversion: 2.1 time: 1.474537 Jun 16 17:34:12.805192 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 1/3] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:11 2022] GET /compute/v2.1/os-volumes/7248f5b3-0a27-4408-be8a-566db81c64bb => generated 351 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:12.805631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e67f69eb-fcdf-4da1-a2e9-950c4cbf2619 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Calling method '.version_select at 0x7f84ac23f940>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:12.873741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e67f69eb-fcdf-4da1-a2e9-950c4cbf2619 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689" status: 200 len: 353 microversion: 2.1 time: 0.078835 Jun 16 17:34:12.874622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:12 2022] GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:34:12.891774 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-90aeecc9-3798-4e94-a5ad-7e7c7815bd41 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Calling method '.version_select at 0x7f84ac280670>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:13.498643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-90aeecc9-3798-4e94-a5ad-7e7c7815bd41 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689" status: 202 len: 0 microversion: 2.1 time: 0.610641 Jun 16 17:34:13.499386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 2/5] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:34:12 2022] DELETE /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:34:13.508433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-99b9f289-c5b8-4d3a-bd4a-d20856d7cdee tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Calling method '.version_select at 0x7f84ac23fd30>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:13.630439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-99b9f289-c5b8-4d3a-bd4a-d20856d7cdee tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689" status: 200 len: 352 microversion: 2.1 time: 0.126564 Jun 16 17:34:13.633221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 4/6] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:13 2022] GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:14.643272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ba57284-e6a8-4d58-b5ff-55a94e322a29 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Calling method '.version_select at 0x7f84ac251430>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:14.644013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ef0a761f-a382-403b-bed9-ad2b20676737 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac2805e0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:14.720679 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-3ba57284-e6a8-4d58-b5ff-55a94e322a29 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] HTTP exception thrown: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ba57284-e6a8-4d58-b5ff-55a94e322a29 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Request method failure captured: Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 HTTP/1.1 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mRoinCBVPECjFwggOyMl2MCwDC7xPdnSg8YVkRmr2IvXalHYCyoVYLgTf1TtWlDNQG8CHH64OTtrtv0B3aArzJaOMOui_-BStHO7bGDBBFlTNpLTw06CP7EuKZoZQ-OewUtrQWKdiAi9LcWvaCiILFg3yV5OJGYMIv-jwC-zUPIho Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 7dc9438583194d70b654dd8ce36417e7 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesGetTestJSON-179372105 Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:34:14.726866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7dc9438583194d70b654dd8ce36417e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7dc9438583194d70b654dd8ce36417e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7dc9438583194d70b654dd8ce36417e7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7dc9438583194d70b654dd8ce36417e7"}]}] Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesGetTestJSON-179372105 Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 7dc9438583194d70b654dd8ce36417e7 Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesGetTestJSON-179372105 Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesGetTestJSON-179372105-project Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 09185fe6124c4663b2f974616a8120b8 Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesGetTestJSON-179372105-project Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '81db8f7d-4fe9-4cb9-a26d-b4ab371d7689'} Jun 16 17:34:14.728286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. (HTTP 404) (Request-ID: req-79a8f87a-5ae5-4083-b8d1-33c4748f84c6) Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:14.729123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:34:14.730372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:34:14.731525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. Jun 16 17:34:14.732662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:34:14.735520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ba57284-e6a8-4d58-b5ff-55a94e322a29 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] Returning 404 to user: Volume 81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:34:14.737203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3ba57284-e6a8-4d58-b5ff-55a94e322a29 tempest-VolumesGetTestJSON-179372105 tempest-VolumesGetTestJSON-179372105-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689" status: 404 len: 109 microversion: 2.1 time: 0.097572 Jun 16 17:34:14.738053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 5/7] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:14 2022] GET /compute/v2.1/os-volumes/81db8f7d-4fe9-4cb9-a26d-b4ab371d7689 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:34:14.846742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ef0a761f-a382-403b-bed9-ad2b20676737 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b9fad167-0fb0-41a0-b022-01b1d00a4c39" status: 200 len: 350 microversion: 2.1 time: 0.213971 Jun 16 17:34:14.848290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 3/8] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:14 2022] GET /compute/v2.1/os-volumes/b9fad167-0fb0-41a0-b022-01b1d00a4c39 => generated 350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:16.865704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8273e673-bce2-4dda-91a0-59911c2cffbe tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac251dc0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.031660 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8273e673-bce2-4dda-91a0-59911c2cffbe tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d64f6791-0e6d-4106-b0bd-7accc1df787a" status: 200 len: 351 microversion: 2.1 time: 0.179203 Jun 16 17:34:17.032571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 6/9] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:34:16 2022] GET /compute/v2.1/os-volumes/d64f6791-0e6d-4106-b0bd-7accc1df787a => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:17.044812 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1ac2b323-440d-4379-9218-292ab71d54cd tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac280e50>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.184673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1ac2b323-440d-4379-9218-292ab71d54cd tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.143724 Jun 16 17:34:17.185268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 4/10] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:17.199922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8c243829-da36-46ca-a0d8-7126ef789a4f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac1bf4c0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.501598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8c243829-da36-46ca-a0d8-7126ef789a4f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.303338 Jun 16 17:34:17.508829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 7/11] 10.222.0.40 () {58 vars in 1148 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:17.515049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1ae43135-045c-480e-8846-dabc63df9c7f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac280ee0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:17.844094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1ae43135-045c-480e-8846-dabc63df9c7f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.333552 Jun 16 17:34:17.844684 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:17.856995 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-162ed020-7937-4ab6-8d16-37135cf1814a tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84acc25940>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.168650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-162ed020-7937-4ab6-8d16-37135cf1814a tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.315422 Jun 16 17:34:18.181482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1166 bytes} [Thu Jun 16 17:34:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:18.194847 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6579dc59-e716-47cd-86ab-17e4b43bad6e tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac250310>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.389718 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6579dc59-e716-47cd-86ab-17e4b43bad6e tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.200048 Jun 16 17:34:18.390561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 6/14] 10.222.0.40 () {58 vars in 1169 bytes} [Thu Jun 16 17:34:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:18.403496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-19311316-cf6a-472a-84b8-7d579fe8c068 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac1bfe50>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.615811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-19311316-cf6a-472a-84b8-7d579fe8c068 tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.216715 Jun 16 17:34:18.616394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 9/15] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jun 16 17:34:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:18.627699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8aae001f-f790-485f-9c7c-18645eb28c0f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac250f70>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.791914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8aae001f-f790-485f-9c7c-18645eb28c0f tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.167901 Jun 16 17:34:18.792757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 7/16] 10.222.0.40 () {58 vars in 1187 bytes} [Thu Jun 16 17:34:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:18.805278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0e31c01c-9f57-46b1-99c3-c1d3e31048ab tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] Calling method '.version_select at 0x7f84ac25daf0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:18.983932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0e31c01c-9f57-46b1-99c3-c1d3e31048ab tempest-VolumesTestJSON-2134681425 tempest-VolumesTestJSON-2134681425-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.183792 Jun 16 17:34:18.985326 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 10/17] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jun 16 17:34:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:24.236768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-670075737", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:24.480007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] validate_networks() for [('dd7b32b9-764e-43c1-a67e-f0e3f862c460', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:25.680090 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-428002517", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "networks": [{"uuid": "7e2159b7-0000-4264-ad94-d6ffac5ae98d"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:25.910113 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] validate_networks() for [('7e2159b7-0000-4264-ad94-d6ffac5ae98d', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:27.324187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:27.324657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:27.325076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:27.325933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:27.326359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:27.366898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.370670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.371920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:27.372759 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:27.521278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:27.547943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for user a5c37b79bf3d40f4a6182cc296585c18 and project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:27.586568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:27.594200 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:27.812328 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2c82fc8b-0476-4074-878f-9ad6e1abdec0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.979393 Jun 16 17:34:27.821042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 8/18] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:27.838529 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d87f08f2-086d-4bd9-a746-c229635f04b4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:27.845922 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d87f08f2-086d-4bd9-a746-c229635f04b4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:27.958089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:27.958628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:27.959164 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:27.959568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:27.960491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:28.023257 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:28.023896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:28.027437 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:28.028346 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:28.096075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d87f08f2-086d-4bd9-a746-c229635f04b4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:28.121517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d87f08f2-086d-4bd9-a746-c229635f04b4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1221 microversion: 2.1 time: 0.296395 Jun 16 17:34:28.139010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 9/19] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:27 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1221 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:28.142630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Getting quotas for project 4537634610c645db8bdb7c704c09ee71. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:28.159157 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Getting quotas for user cbe7720ab8b7414a8c336de368ae1ec4 and project 4537634610c645db8bdb7c704c09ee71. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:28.201597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:28.204379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:28.479078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1ffae784-40e2-42f6-9f6e-2087928a2900 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.531357 Jun 16 17:34:28.480395 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:28.491230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4ef5a0e4-bc0c-4d02-b6b1-c3d05d5d5812 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:28.492554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4ef5a0e4-bc0c-4d02-b6b1-c3d05d5d5812 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:28.578405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2070884763", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:28.667268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4ef5a0e4-bc0c-4d02-b6b1-c3d05d5d5812 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:28.682460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4ef5a0e4-bc0c-4d02-b6b1-c3d05d5d5812 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1214 microversion: 2.1 time: 0.193551 Jun 16 17:34:28.692587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 10/21] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:28 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:28.764966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] validate_networks() for [('dd7b32b9-764e-43c1-a67e-f0e3f862c460', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:29.856332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:29.857064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:29.857799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:29.858408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:29.859067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:29.890096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:29.891706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:29.892776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:29.896407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:29.953729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:29.967672 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for user a5c37b79bf3d40f4a6182cc296585c18 and project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:29.998142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-66cdedb3-ac89-4554-aa4c-fc3a4d8f7b27 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: .version_select at 0x7f84ab10dca0>, body: {"keypair": {"name": "tempest-keypair-1845832376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDmdbM9OqApL/oHtuXFQsTeFHgQF9qr5gpKcrvN8A4whLwYltR1pTZPJv6g917+ewd5nfyj5yyW66c/Incp6o9ATzFtqBaQK9gjxdsaG7PSwWiDq+38ahGaZLRFvD31Kg=="}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:30.003593 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:30.013317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:30.111337 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-66cdedb3-ac89-4554-aa4c-fc3a4d8f7b27 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:30.134660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-66cdedb3-ac89-4554-aa4c-fc3a4d8f7b27 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:30.177723 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1afa637c-6149-4976-9cc5-efde3d09ef77 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.603405 Jun 16 17:34:30.185409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 12/22] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:30.203211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bebbd6a4-fb0f-49a2-b7ac-fadaeb7424bf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:30.205622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bebbd6a4-fb0f-49a2-b7ac-fadaeb7424bf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:30.291326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-66cdedb3-ac89-4554-aa4c-fc3a4d8f7b27 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.306300 Jun 16 17:34:30.301226 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 11/23] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:34:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:34:30.321023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-63a919ac-d107-42a1-a706-89c76e5137d0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:30.321859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-63a919ac-d107-42a1-a706-89c76e5137d0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:30.464369 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bebbd6a4-fb0f-49a2-b7ac-fadaeb7424bf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:30.523292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bebbd6a4-fb0f-49a2-b7ac-fadaeb7424bf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1214 microversion: 2.1 time: 0.335700 Jun 16 17:34:30.524509 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 13/24] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:30 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1214 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:30.610654 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-63a919ac-d107-42a1-a706-89c76e5137d0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:30.628584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-63a919ac-d107-42a1-a706-89c76e5137d0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1222 microversion: 2.1 time: 0.321190 Jun 16 17:34:30.637479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 12/25] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:30 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:31.471988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8cb8e12f-6a69-41e6-b4f7-ffdce684d5f6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: .version_select at 0x7f84ab8c5ca0>, body: {"keypair": {"name": "tempest-keypair-1465592310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpI3HY5UXS6Au7BbAq5K7mHlrQxRX4qbz+Ohyu8g6ZBZu8id1NO3F/pspsYRFFqrTV3+GABi+W2jq2LbCm6TcxdUiPia8aJjZwmEDHlHkRQjrKhJeREVWudjo1zBJWgYQ=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:31.537871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-8cb8e12f-6a69-41e6-b4f7-ffdce684d5f6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for project 4904f0e2f64e4bef989f441380e843b5. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:31.545989 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:31.546610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:31.549532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-8cb8e12f-6a69-41e6-b4f7-ffdce684d5f6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for user 3faab41439184fecbb3e1021eb81d555 and project 4904f0e2f64e4bef989f441380e843b5. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:31.556806 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:31.557612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:31.558625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:31.559329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:31.703680 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8cb8e12f-6a69-41e6-b4f7-ffdce684d5f6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.142935 Jun 16 17:34:31.723870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 14/26] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:34:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:31.746465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-93c82e54-523e-4c00-8c04-7862245e330d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:31.750724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-93c82e54-523e-4c00-8c04-7862245e330d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:32.050728 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-93c82e54-523e-4c00-8c04-7862245e330d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:32.063811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-93c82e54-523e-4c00-8c04-7862245e330d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1222 microversion: 2.1 time: 0.337231 Jun 16 17:34:32.066105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 15/27] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:31 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1222 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:32.135955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:32.164286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1d7c7e09-065c-4c08-9a6c-088747e7e2f7 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1218 microversion: 2.1 time: 0.621534 Jun 16 17:34:32.165119 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 13/28] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:31 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1218 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:33.083254 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:33.084189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:33.094362 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:33.111497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:33.113547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:33.120053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:33.183104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:33.184120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:33.202394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:33.203007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:33.209591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:33.210058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:33.458583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:33.470962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fa63dd06-1776-45e3-9e74-6e8a0ebafcdd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1274 microversion: 2.1 time: 0.293284 Jun 16 17:34:33.475386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 14/29] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:33 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:33.625094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:33.649303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4f22413e-219c-475e-965d-0dbbebb89b4b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1274 microversion: 2.1 time: 0.569865 Jun 16 17:34:33.660960 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 16/30] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:33 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1274 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:34.498152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:34.500512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:34.525508 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:34.528690 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:34.534860 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:34.537567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:34.670540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:34.672633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:34.707359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:34.708543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:34.711511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:34.713254 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:34.838476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:34.883027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-68662a7a-2927-4b28-9a91-d27d7ef7bbf0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1272 microversion: 2.1 time: 0.392650 Jun 16 17:34:34.887935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 15/31] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:34 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1272 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:35.314594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:35.331070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3d0ab00c-820b-4d7c-8069-06952b5625a2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1280 microversion: 2.1 time: 0.667368 Jun 16 17:34:35.367536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 17/32] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:34 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1280 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:35.907309 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:35.908016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:35.941219 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:35.954189 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:35.960249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:35.960875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:36.357910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:36.359258 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:36.378956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:36.385526 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:36.390641 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:36.391122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:36.395111 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:36.412084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e3ebfdf4-6466-4f4f-bc96-a3bd4ab52da9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1272 microversion: 2.1 time: 0.510354 Jun 16 17:34:36.414873 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 16/33] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:35 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:36.832402 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:36.848041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f48d4c00-e4ff-4eae-8af7-65a9c93aff9b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1280 microversion: 2.1 time: 0.494339 Jun 16 17:34:36.861497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 18/34] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:36 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1280 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:37.473114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:37.485722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:37.493359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:37.511951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:37.512745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:37.516880 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:37.519421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:37.868454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:37.871529 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:37.900738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:37.905450 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:37.912661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:37.914985 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:39.269685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:39.280022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-539e6243-4f37-4af3-bc60-06c1a9c537da tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 1.852468 Jun 16 17:34:39.293608 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 17/35] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:37 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:39.307760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-576430117", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb674c9-6bb7-4c32-892c-b28837e89812"}], "security_groups": [{"name": "tempest-securitygroup--1641771906"}], "key_name": "tempest-keypair-1845832376", "user_data": "}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:39.322706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:39.334438 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7ffb1b4d-6b1e-4fa1-b70d-a4bb2e10ac9a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 1.470725 Jun 16 17:34:39.335502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 19/36] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:37 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:39.348732 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1866541415", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7174c275-7bd9-4bad-898d-52e5729a7a31"}], "security_groups": [{"name": "tempest-securitygroup--414680839"}], "key_name": "tempest-keypair-1465592310", "user_data": "}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:39.625556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] validate_networks() for [('6fb674c9-6bb7-4c32-892c-b28837e89812', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:39.637264 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] validate_networks() for [('7174c275-7bd9-4bad-898d-52e5729a7a31', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:34:39.919113 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:40.616361 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=16 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:40.681418 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:40.682889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:40.684153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:40.684872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:40.685598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:40.719737 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.722526 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:40.728390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.730886 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:40.746973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:34:40.748016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:34:40.748731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:34:40.749996 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:34:40.750680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:34:40.767423 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.768888 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:40.770287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.771004 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:40.789521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for project 4904f0e2f64e4bef989f441380e843b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:40.796375 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:34:40.802698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:40.803814 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for user 3faab41439184fecbb3e1021eb81d555 and project 4904f0e2f64e4bef989f441380e843b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:34:40.819176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:40.822039 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:40.838828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:34:40.841652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:34:40.918650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3694a896-c6ce-40f2-9544-89d17e0c6251 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622730 Jun 16 17:34:40.925494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:40.933483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:40.934580 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:40.945597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.948019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:40.949434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:40.952647 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:41.020032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b1c59493-5ef4-4a06-a3de-047a27b900b0 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.679950 Jun 16 17:34:41.022275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 20/38] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:34:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:34:41.038842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:41.043998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:41.068476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:41.068938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:41.073100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:41.075757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:42.203139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:42.218668 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-49857667-3aa3-491f-ac80-4b78283dc033 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 1.290634 Jun 16 17:34:42.223896 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 19/39] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:40 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:42.256753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d502ff13-113e-4917-ab88-542034c3a1f9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:42.257780 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d502ff13-113e-4917-ab88-542034c3a1f9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:42.831244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d502ff13-113e-4917-ab88-542034c3a1f9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:42.839797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d502ff13-113e-4917-ab88-542034c3a1f9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1241 microversion: 2.1 time: 0.588536 Jun 16 17:34:42.840426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:42 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1241 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:42.889318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:42.897278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:42.921758 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:42.923295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:42.924745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:42.925163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:43.474208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:43.490069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e9f9f5bf-897d-4f9c-b2e9-cc0dcf75cb03 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1234 microversion: 2.1 time: 0.640079 Jun 16 17:34:43.500319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 21/41] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:42 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1234 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:43.513267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:43.514069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:43.526444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:43.527056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:43.530085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:43.533867 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:43.658316 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:43.675519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d9fcda5b-7446-4133-a61c-937f38295b00 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 2.645982 Jun 16 17:34:43.676313 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 21/42] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:41 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:43.858276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:43.861129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:43.880185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:43.880655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:43.883567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:43.884274 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:44.623798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:44.648187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-808545d5-fefe-4dc3-a1e9-847ae73484f7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1293 microversion: 2.1 time: 0.785928 Jun 16 17:34:44.649241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:43 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1293 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:44.665597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:44.668234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:44.682041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:44.682927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:44.684944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:44.685979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:45.360861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:45.370246 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-847850f3-845c-47b9-aab8-014c77a1e0cc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1308 microversion: 2.1 time: 0.719181 Jun 16 17:34:45.388696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 23/44] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:44 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:45.584681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-db36ca9b-9289-4c69-87c6-7a85f7b162be req-c9938434-3630-48b2-8192-351b89bf081d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69", "tag": "86749e9f-ddc9-40e0-90f0-7a85e2519bf8"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:45.643812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-db36ca9b-9289-4c69-87c6-7a85f7b162be req-c9938434-3630-48b2-8192-351b89bf081d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:45.644776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-db36ca9b-9289-4c69-87c6-7a85f7b162be req-c9938434-3630-48b2-8192-351b89bf081d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:45.700987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-db36ca9b-9289-4c69-87c6-7a85f7b162be req-c9938434-3630-48b2-8192-351b89bf081d service nova] Creating event network-changed:86749e9f-ddc9-40e0-90f0-7a85e2519bf8 for instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 on hv-cinder-83754 Jun 16 17:34:45.702950 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-db36ca9b-9289-4c69-87c6-7a85f7b162be req-c9938434-3630-48b2-8192-351b89bf081d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:34:45.712445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:45.714410 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:45.716760 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:45.717749 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:45.774708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.compute.rpcapi [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:34:45.774708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:34:45.821120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e6d80286-2dd6-4a9e-8966-161395ee40b7 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.430677 Jun 16 17:34:45.823422 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 24/45] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:45.833970 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:45.834936 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:45.844350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:45.845123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:45.847853 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:45.848248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:46.477360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:46.487023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e8d43c87-f328-4fa6-b944-194c6f54ffef tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 2.984954 Jun 16 17:34:46.504821 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 22/46] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:43 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 3004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:46.527217 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:46.530654 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:46.546262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:46.548482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:46.550277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:46.553788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:46.803256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:46.815625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3ecafbea-4cb3-487e-bc07-6e25aa2dc4d0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1299 microversion: 2.1 time: 0.306921 Jun 16 17:34:46.817374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 23/47] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:46 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1299 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:46.829784 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:46.835804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:46.851394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:46.853020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:46.856785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:46.865474 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:47.168640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:47.185249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-eca14378-6ce9-473e-881a-fe55addc3d5e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1296 microversion: 2.1 time: 0.363574 Jun 16 17:34:47.190186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 24/48] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:46 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1296 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:47.509077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:47.514665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:47.523118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:47.535056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:47.539514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:47.540215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:47.966376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:47.980955 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e9dd800d-32ac-455a-a114-86fd9ac25d19 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 2.156088 Jun 16 17:34:47.998534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 25/49] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:45 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:48.008698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:48.011743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:48.040003 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:48.040878 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:48.042099 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:48.042998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:48.317533 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:48.340328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-95658074-f69f-490b-bb8d-0b3847dbb06f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1299 microversion: 2.1 time: 0.339628 Jun 16 17:34:48.342550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 26/50] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:47 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:48.357711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:48.361112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:48.392690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:48.402279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:48.403835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:48.404691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:49.506182 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:49.516794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0e169a93-fa9d-441d-8f3f-4efa07ba04d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1296 microversion: 2.1 time: 1.168441 Jun 16 17:34:49.526485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 27/51] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:48 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1296 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:49.629797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:49.645945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5e347b32-86f0-4b5e-ad78-fb9091a4bd92 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 2.137048 Jun 16 17:34:49.669347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 25/52] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:47 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:49.697455 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:49.698370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:49.717875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:49.718334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:49.719123 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:49.719561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:49.996836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-4086611c-e06a-4152-a587-b5544e035c77 req-d7edc3e3-89b9-475c-898f-2f12b91b95e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fe7037-080f-4209-bdc6-c505c4c34ec3", "tag": "62e3038f-b183-4ed1-bedd-da99fe182bf8"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:50.085312 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4086611c-e06a-4152-a587-b5544e035c77 req-d7edc3e3-89b9-475c-898f-2f12b91b95e0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.085842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4086611c-e06a-4152-a587-b5544e035c77 req-d7edc3e3-89b9-475c-898f-2f12b91b95e0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.130817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-4086611c-e06a-4152-a587-b5544e035c77 req-d7edc3e3-89b9-475c-898f-2f12b91b95e0 service nova] Creating event network-changed:62e3038f-b183-4ed1-bedd-da99fe182bf8 for instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 on hv-cinder-83754 Jun 16 17:34:50.148798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-4086611c-e06a-4152-a587-b5544e035c77 req-d7edc3e3-89b9-475c-898f-2f12b91b95e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.618546 Jun 16 17:34:50.150123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 28/53] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:50.170553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:50.176969 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:50.203297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.204304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.213830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.218534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.496059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:50.505520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8a07223e-ce7a-472c-8d14-1b966129367f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1299 microversion: 2.1 time: 0.352979 Jun 16 17:34:50.511820 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 29/54] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:50 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1299 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:50.536321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:50.539217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:50.553975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.554728 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.556595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.557420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.784181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:50.802543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:50.810730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2bb11569-5daa-4610-8992-806cc19db577 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 1.129164 Jun 16 17:34:50.815297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 26/55] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:49 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:50.823946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=26 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:50.824866 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:50.827107 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:50.844009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.845417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:50.849040 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:50.849733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.527181 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:51.539989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ba0f2ba2-a720-4766-9af6-89e090baaf8c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 1.007533 Jun 16 17:34:51.551587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 30/56] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:50 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:51.562039 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:51.563058 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:51.579773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:51.590527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.591235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.592651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.600802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.665975 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:51.674503 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ad8a3174-03a2-4bc7-8d87-dc7e28599d9a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.857920 Jun 16 17:34:51.677886 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 27/57] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:50 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:51.760103 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-c1d1b212-a8d9-4cb8-918f-c11dba59673f req-29bd99f1-ecb3-4ea5-83a6-b3e5dc615abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea8edce-fee8-4dbd-ae01-e4d060cf5597", "tag": "4e13aef5-2de9-4312-9c58-333292fceaab"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:51.784253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-c1d1b212-a8d9-4cb8-918f-c11dba59673f req-29bd99f1-ecb3-4ea5-83a6-b3e5dc615abc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.786124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-c1d1b212-a8d9-4cb8-918f-c11dba59673f req-29bd99f1-ecb3-4ea5-83a6-b3e5dc615abc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.854447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-c1d1b212-a8d9-4cb8-918f-c11dba59673f req-29bd99f1-ecb3-4ea5-83a6-b3e5dc615abc service nova] Creating event network-changed:4e13aef5-2de9-4312-9c58-333292fceaab for instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 on hv-cinder-83754 Jun 16 17:34:51.855243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-c1d1b212-a8d9-4cb8-918f-c11dba59673f req-29bd99f1-ecb3-4ea5-83a6-b3e5dc615abc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124160) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 17:34:51.858003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.861482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.862620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.863208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.905369 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:51.907679 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.compute.rpcapi [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 17:34:51.909760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] Releasing lock "compute-rpcapi-router" {{(pid=124160) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 17:34:51.915503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ef6c8c7f-4b56-4e24-8bba-10826ec61d9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.358290 Jun 16 17:34:51.923168 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 31/58] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:51 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:51.946639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aa22439c-5fdb-4249-a4f4-aa84e3f5f0ad None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189873 Jun 16 17:34:51.948239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:51.948394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 28/59] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:34:51.949834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:51.961110 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.961591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:51.962379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:51.962831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.217278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-985b2d37-7bd7-4745-9186-10833f2b9c47 req-7ee60a88-c60b-454d-a12a-0e52a8bbeb20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be99b296-6cc1-4b2a-977c-113f47796148", "tag": "cb17776a-79c0-4129-90a0-ae34814d798c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:52.231849 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-985b2d37-7bd7-4745-9186-10833f2b9c47 req-7ee60a88-c60b-454d-a12a-0e52a8bbeb20 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:52.232525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-985b2d37-7bd7-4745-9186-10833f2b9c47 req-7ee60a88-c60b-454d-a12a-0e52a8bbeb20 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.264450 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-985b2d37-7bd7-4745-9186-10833f2b9c47 req-7ee60a88-c60b-454d-a12a-0e52a8bbeb20 service nova] Creating event network-changed:cb17776a-79c0-4129-90a0-ae34814d798c for instance be99b296-6cc1-4b2a-977c-113f47796148 on hv-cinder-83754 Jun 16 17:34:52.272487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-985b2d37-7bd7-4745-9186-10833f2b9c47 req-7ee60a88-c60b-454d-a12a-0e52a8bbeb20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061192 Jun 16 17:34:52.274879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 29/60] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:34:52.350887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:52.362100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-47e59722-a408-4d4a-a160-3daa509c1c31 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.426721 Jun 16 17:34:52.363454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 32/61] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:51 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:52.562072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:52.562987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:52.573825 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:52.579207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.582387 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:52.587093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.701104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:52.703003 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:52.724737 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:52.725561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.727675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:52.729479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:52.782567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:52.836862 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=8 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:53.068586 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:53.084485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ee99bb9e-1e44-4087-9559-258bbf516151 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.530049 Jun 16 17:34:53.085493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 30/62] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:52 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:53.101165 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:53.104146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:53.122487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:53.127456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:53.129659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:53.130963 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:53.374217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:53.386922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bdd6728d-7fc0-42a7-a493-6f2b0aab62aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.693982 Jun 16 17:34:53.402932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 33/63] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:52 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:53.416545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:53.419224 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:53.436742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:53.437464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:53.438817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:53.440077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:53.815803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:53.820411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:53.837955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a51fbe1e-bc6c-49a9-9f77-9493f0c76660 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.748142 Jun 16 17:34:53.839711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 31/64] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:53 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:53.927825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:53.942677 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c1a0ee14-1d08-455d-86e9-dfc426299788 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.535017 Jun 16 17:34:53.945447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 34/65] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:53 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:54.103815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:54.105278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:54.110195 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:54.122308 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.123338 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.125087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.125776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.302538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-05459f29-c152-4529-b648-5f9efada6242 req-c3072e1d-a627-4036-afdd-df615931d4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e052a589-f2aa-4711-8beb-2171defad99e", "tag": "34435ad7-815c-4541-888a-58d96e70159f"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:34:54.316086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-05459f29-c152-4529-b648-5f9efada6242 req-c3072e1d-a627-4036-afdd-df615931d4bc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.317534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-05459f29-c152-4529-b648-5f9efada6242 req-c3072e1d-a627-4036-afdd-df615931d4bc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.351815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-05459f29-c152-4529-b648-5f9efada6242 req-c3072e1d-a627-4036-afdd-df615931d4bc service nova] Creating event network-changed:34435ad7-815c-4541-888a-58d96e70159f for instance e052a589-f2aa-4711-8beb-2171defad99e on hv-cinder-83754 Jun 16 17:34:54.362485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-05459f29-c152-4529-b648-5f9efada6242 req-c3072e1d-a627-4036-afdd-df615931d4bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063703 Jun 16 17:34:54.364001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 35/66] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:34:54.412401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:54.414277 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:54.432857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.434534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.435633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.438608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.531429 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:54.541804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3156ff1b-3abf-4ecf-8743-ae18cbe08797 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.443498 Jun 16 17:34:54.543614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 32/67] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:54 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:54.664216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:54.674153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ec28edb0-ebbf-4d3a-8357-40564e5968f0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.269157 Jun 16 17:34:54.675421 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 36/68] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:54 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:54.857845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:54.858509 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:54.865838 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.866828 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.867933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.868575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.961307 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:54.962248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:54.971993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.972607 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:54.973880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:54.974463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:55.062581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:55.073059 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d68f3da8-0d76-423d-a24e-79feb9be3047 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.220072 Jun 16 17:34:55.074506 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 33/69] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:54 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:55.162699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:55.171511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8c3407cc-42cf-4ba9-bdaa-82a1482b2ade tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.215181 Jun 16 17:34:55.182296 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 37/70] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:54 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:55.560153 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:55.561324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:55.570411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:55.571063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:55.571986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:55.572662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:55.695753 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:55.697486 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:55.705574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:55.706543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:55.707623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:55.708265 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:55.768553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:34:55.801043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:55.808879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7053cbc1-b4a2-492d-bd5f-f2b8b2757656 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.252931 Jun 16 17:34:55.817655 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 34/71] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:55 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:55.913546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:55.921479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bbeca8f1-bf3c-4fd7-b522-e8606c92054a tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.234460 Jun 16 17:34:55.925224 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 38/72] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:55 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:34:56.094469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:56.113777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:56.137986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.138628 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.139695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.140264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.191584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:56.193329 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:56.221926 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.229107 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.247364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.250158 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.443417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:56.454007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1b98e09c-7cc4-4340-bb6d-c0ebe2d49cf8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.363605 Jun 16 17:34:56.455747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 35/73] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:56 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:56.474139 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:56.483266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d6855329-607e-4cbe-92e3-63612bd02284 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.297018 Jun 16 17:34:56.484447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 39/74] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:56 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:56.832166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:56.832910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:56.839435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.839889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.842235 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.842235 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.942228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:56.943276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:56.956235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.957748 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.959704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:56.961409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:56.995651 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:57.005947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d9270c0d-4690-45d5-9611-d212752c0070 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.181345 Jun 16 17:34:57.008332 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 36/75] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:56 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:57.134330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:57.143268 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fcb812ab-1376-492b-895c-69c7742f497e tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.208549 Jun 16 17:34:57.152979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 40/76] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:56 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:57.472585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:57.473815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:57.485769 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:57.486494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:57.487602 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:57.488958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:57.503048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:57.504343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:57.521477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:57.522215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:57.523236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:57.525412 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:57.972035 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:57.988303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b0374b05-a7e4-47f1-93b9-435b220e0ba5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.489978 Jun 16 17:34:57.989084 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 41/77] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:57 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:58.028036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:58.032151 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:58.033701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:58.038932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-641f5b96-c44d-4cae-8876-867e686a7b71 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.570741 Jun 16 17:34:58.039938 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 37/78] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:57 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:58.042406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:58.042928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:58.043825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:58.044933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:58.164151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:58.164871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:58.178761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:58.178761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:58.179273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:58.179273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:58.297922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:58.308578 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cf809225-b994-4e60-8b9f-83a0dc46eed4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.287871 Jun 16 17:34:58.309599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 42/79] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:58 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:58.350162 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:58.357965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-38b95f20-4d1b-4eba-b867-1dda8cd4bae0 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.197623 Jun 16 17:34:58.358540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 38/80] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:58 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:59.011238 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:59.012900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:59.021441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.022270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.023398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.023880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.057331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:59.058632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:59.071013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.071763 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.072711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.073369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.344300 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:59.352382 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a6121530-b623-4370-a5c7-8b27e8dc2f40 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.350532 Jun 16 17:34:59.353037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 43/81] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:59 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:59.357986 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:59.358724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:59.365857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.366298 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.367060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.367485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.384956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:59.395043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-74cdfb70-70ba-423f-925f-b86355833862 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.342003 Jun 16 17:34:59.395639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 39/82] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:59 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:59.401174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:34:59.401854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:34:59.408526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.408984 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.409785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:34:59.410230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:34:59.609034 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:59.624165 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:34:59.629464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d43f2413-987f-4b87-9c9b-9968864e8534 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.275111 Jun 16 17:34:59.642943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 44/83] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:59 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:34:59.643240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6c1dd09b-650b-4bd3-a5e0-92b3bfdaaa8f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.239365 Jun 16 17:34:59.643240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 40/84] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:34:59 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:00.370882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:00.372341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:00.378355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.379141 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.380208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.380850 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.415063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:00.416325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:00.423168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.424303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.425625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.426249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.764993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:00.779265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:00.787618 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a638f5c0-ceab-4449-b2c0-a216fa22794c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.420898 Jun 16 17:35:00.789075 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 45/85] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:00 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:00.789838 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d16e1e88-caa7-42ed-99d8-faf0e7c19914 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.382098 Jun 16 17:35:00.800791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:00.800791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:00.802817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 41/86] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:00 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:00.803629 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.804510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.805651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.806198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.808704 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:00.809562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:00.816270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.816980 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:00.817969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:00.818588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.050247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:01.064116 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:01.071454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b150e6ce-3113-4a3b-a204-0470074507aa tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.266967 Jun 16 17:35:01.072030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 42/87] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:00 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:01.079889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-98653624-5db7-4c97-a305-7f167b6d0d1f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.289440 Jun 16 17:35:01.080613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 46/88] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:00 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:01.804194 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:01.804805 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:01.807502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:01.808114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:01.811273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.811722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.812518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.812955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.814743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.815183 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.815938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:01.816366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:01.905915 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:02.011746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:02.019187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:02.020055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-88e4801d-6b07-4ea6-bf17-95329671714f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.219876 Jun 16 17:35:02.020652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 43/89] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:01 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:02.026801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9b8d238b-7984-4c50-afff-618f20da289c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.223007 Jun 16 17:35:02.027402 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 47/90] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:01 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:02.089349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:02.089908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:02.095909 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:02.096345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:02.097097 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:02.097555 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:02.097729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:02.098341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:02.104343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:02.104790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:02.105579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:02.106016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:02.295587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:02.300065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:02.304824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0ebffaae-00fc-4a35-937f-7e54d1a62b9f tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.219314 Jun 16 17:35:02.305551 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 44/91] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:02 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:02.307476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6339536e-f73b-4d4e-b7ea-71f0d2b78ca8 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.213623 Jun 16 17:35:02.308041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 48/92] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:02 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:03.036486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:03.037103 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:03.043351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.043550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:03.043988 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.044123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:03.044545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.044980 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.050672 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.051122 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.051893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.052330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.242128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:03.242243 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:03.245408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3ccdc145-8a18-4fd1-8821-e1daa2d25b83 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.213367 Jun 16 17:35:03.245987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 45/93] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:03 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:03.248612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c0207f75-3038-4e51-a53c-da5a7211bfe2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.208876 Jun 16 17:35:03.249266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 49/94] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:03 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:03.323181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:03.323878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:03.324699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:03.325349 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:03.331416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.331887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.331990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.332339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.332748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.333186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.333535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:03.333965 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:03.526383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:03.529934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:03.542516 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:03.557482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9a71f32d-b85e-439f-a51f-2b15989cfa54 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.236939 Jun 16 17:35:03.560215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 46/95] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:03 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:03.561186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e531e8c5-9dd5-4e76-80be-b08ecece064a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.239871 Jun 16 17:35:03.571991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 50/96] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:03 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:04.264038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:04.265269 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:04.269545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:04.270216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:04.271725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.272179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.272941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.273398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.277226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.277684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.278491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.278980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.654381 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:04.664323 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:04.668748 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-20ea8dea-19c4-4867-8afd-f62139840398 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.404608 Jun 16 17:35:04.669189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 51/97] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:04 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:04.682138 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:04.683002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d889bb07-0474-4ca6-96a1-5a935e19c994 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.421223 Jun 16 17:35:04.683142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:04.683966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 47/98] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:04 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:04.690388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:04.691173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:04.697093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.697401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.697585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.698190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.698349 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.698796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.699318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:04.700127 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:04.741905 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:04.953054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:04.959863 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:04.976208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5d518cb5-f6ef-4442-bd86-1026a8f4a865 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.305555 Jun 16 17:35:04.977441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9e9089d5-70ee-44a3-a150-a44df57d04bd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.291225 Jun 16 17:35:04.977441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 48/99] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:04 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:05.004081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 52/100] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:04 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:05.152761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-160621b6-035a-4343-8476-2aca826cab9e req-6870bae5-ab52-42d3-a418-d0bd6ffffde3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69", "name": "network-vif-plugged", "status": "completed", "tag": "86749e9f-ddc9-40e0-90f0-7a85e2519bf8"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:05.162341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-160621b6-035a-4343-8476-2aca826cab9e req-6870bae5-ab52-42d3-a418-d0bd6ffffde3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:05.163001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-160621b6-035a-4343-8476-2aca826cab9e req-6870bae5-ab52-42d3-a418-d0bd6ffffde3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:05.176142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-160621b6-035a-4343-8476-2aca826cab9e req-6870bae5-ab52-42d3-a418-d0bd6ffffde3 service nova] Creating event network-vif-plugged:86749e9f-ddc9-40e0-90f0-7a85e2519bf8 for instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 on hv-cinder-83754 Jun 16 17:35:05.181646 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-160621b6-035a-4343-8476-2aca826cab9e req-6870bae5-ab52-42d3-a418-d0bd6ffffde3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093136 Jun 16 17:35:05.182477 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 49/101] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:05.690603 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:05.691127 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:05.697844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:05.698366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:05.699363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:05.699836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:05.702729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:05.703698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:05.712453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:05.713279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:05.714578 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:05.715223 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.103263 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:06.113564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1d4211e4-8a3c-4683-9365-cc85f21b07a6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.417076 Jun 16 17:35:06.119298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 50/102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:05 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:06.127614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:06.127964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:06.133583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:06.134840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.135297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.136094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.136514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.144699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-37cdd31c-f9df-4205-8add-a772932c349a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.458597 Jun 16 17:35:06.153898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 53/103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:05 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:06.153898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:06.153898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:06.161661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.162375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.163376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:06.164110 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:06.503380 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:06.504067 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:06.511200 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aa4baf3d-d3b0-4dda-9d7f-7c78ce830593 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.389960 Jun 16 17:35:06.512276 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 51/104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:06 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:06.512870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4521d3e0-d8b4-4ad4-b767-c0b3c582d536 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.366225 Jun 16 17:35:06.514032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 54/105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:06 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:07.132614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:07.133271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:07.139256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.139624 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.140387 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.140817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.167948 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:07.167948 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:07.168902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.169399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.170111 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.170540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.328911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:07.337169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7f13ea94-60ec-4d99-9d10-f0f84950e628 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.208270 Jun 16 17:35:07.344079 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 52/106] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:07 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:07.344079 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fe7037-080f-4209-bdc6-c505c4c34ec3", "name": "network-vif-plugged", "status": "completed", "tag": "62e3038f-b183-4ed1-bedd-da99fe182bf8"}, {"server_uuid": "be99b296-6cc1-4b2a-977c-113f47796148", "name": "network-vif-plugged", "status": "completed", "tag": "cb17776a-79c0-4129-90a0-ae34814d798c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:07.356940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.356940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.360182 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:07.367837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-dfad9cf4-3bf2-42c9-b899-5fe887b7c4a0 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.210106 Jun 16 17:35:07.368405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 55/107] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:07 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:07.377370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] Creating event network-vif-plugged:62e3038f-b183-4ed1-bedd-da99fe182bf8 for instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 on hv-cinder-83754 Jun 16 17:35:07.377370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] Creating event network-vif-plugged:cb17776a-79c0-4129-90a0-ae34814d798c for instance be99b296-6cc1-4b2a-977c-113f47796148 on hv-cinder-83754 Jun 16 17:35:07.377370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-8969b967-e6f3-4c4b-b666-852b1604d38c req-c48e2ad6-d808-44bb-bd84-35f5e0d85bf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037395 Jun 16 17:35:07.377370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 53/108] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:07.532594 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:07.533581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:07.540885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:07.541825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:07.548714 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.552330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.552971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.553929 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.554357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.557818 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.558829 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:07.559467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:07.901355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:07.911582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1e835be2-8e22-4e6d-a264-75346cd71c49 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.383433 Jun 16 17:35:07.916910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:07.926468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e070a9e8-3939-4d45-9a34-60a697fdd344 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.389218 Jun 16 17:35:07.927898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 54/109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:07 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:07.929785 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:07 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:08.359879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:08.361331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:08.370959 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.372093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.373011 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.373710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.384896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:08.386527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:08.397572 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.399965 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.403165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.403828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.763589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:08.770804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:08.774036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-384f76ee-1b47-4215-b0e3-4e1c77f8d66b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1322 microversion: 2.1 time: 0.419735 Jun 16 17:35:08.775606 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:08 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:08.784478 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6a1d3999-5d9f-446e-a8aa-07396c817ca7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.403630 Jun 16 17:35:08.785757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:08 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:08.942547 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:08.943388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:08.947178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:08.947959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:08.950814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.951422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.952394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.953017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.953970 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.954415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:08.955169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:08.955595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:09.182703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:09.186742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:09.196060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7de6444d-ff9f-4655-bcca-fa2e380d2bfd tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1314 microversion: 2.1 time: 0.253050 Jun 16 17:35:09.196782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 58/113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:08 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:09.197640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e7bed806-4cef-42bb-a396-9f6af1be8724 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.259907 Jun 16 17:35:09.198225 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 56/114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:08 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:09.392494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-5d9e9179-3393-44ff-94f0-d170a693e90f req-761049e8-ee6d-4b86-ada9-a01b7e7e311f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea8edce-fee8-4dbd-ae01-e4d060cf5597", "name": "network-vif-plugged", "status": "completed", "tag": "4e13aef5-2de9-4312-9c58-333292fceaab"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:09.401180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-5d9e9179-3393-44ff-94f0-d170a693e90f req-761049e8-ee6d-4b86-ada9-a01b7e7e311f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:09.401632 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-5d9e9179-3393-44ff-94f0-d170a693e90f req-761049e8-ee6d-4b86-ada9-a01b7e7e311f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:09.413513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-5d9e9179-3393-44ff-94f0-d170a693e90f req-761049e8-ee6d-4b86-ada9-a01b7e7e311f service nova] Creating event network-vif-plugged:4e13aef5-2de9-4312-9c58-333292fceaab for instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 on hv-cinder-83754 Jun 16 17:35:09.418741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-5d9e9179-3393-44ff-94f0-d170a693e90f req-761049e8-ee6d-4b86-ada9-a01b7e7e311f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030178 Jun 16 17:35:09.419727 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 59/115] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:35:09.795559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:09.796533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:09.804842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:09.807857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:09.814218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:09.816863 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:09.819460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:09.820305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:09.829445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:09.830342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:09.840650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:09.841281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.184803 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:10.212889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-91d66b9d-2c8f-4ae8-af31-c4952fe788e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.400388 Jun 16 17:35:10.215033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 60/116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:09 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:10.226794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:10.232219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:10.243957 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.244414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.245236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.245675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.254489 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:10.263003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-da14fcc8-0491-4a64-ad3d-f5c2a404fc8f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1516 microversion: 2.1 time: 0.474231 Jun 16 17:35:10.264880 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 57/117] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:09 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1516 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:10.270882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:10.271501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:10.282824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.283556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.284812 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.285363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.483741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:10.489661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:10.494231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d51e86e6-6e9b-428c-b986-17d9a4895d02 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1501 microversion: 2.1 time: 0.276783 Jun 16 17:35:10.494931 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 61/118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:10 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:10.501586 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e8224240-45e3-4b4f-bb83-0a2f7ec82bec tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.234669 Jun 16 17:35:10.502779 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 58/119] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:10 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:10.503276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:10.504252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:10.511246 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.511777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.512668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.513063 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.589299 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'flavor' on Instance uuid 54fe7037-080f-4209-bdc6-c505c4c34ec3 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:35:10.753335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-93dde9a5-5470-4924-9159-3cf20cf3c41d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3/action" status: 200 len: 32 microversion: 2.1 time: 0.256988 Jun 16 17:35:10.754178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 62/120] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:35:10 2022] POST /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:35:10.768840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:10.770231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:10.781490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.782629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.784506 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:10.785353 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:10.986534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:10.994132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3169c31c-b156-4ffb-b184-18648d5ac6a7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.233223 Jun 16 17:35:10.994715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 59/121] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:10 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:11.232762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:11.233500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:11.244010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:11.244010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:11.244010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:11.244010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:11.435627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-f140edb5-da36-4fba-bd00-29c84189e43c req-2c4f27be-4f95-438e-abab-ce336f6dee41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e052a589-f2aa-4711-8beb-2171defad99e", "name": "network-vif-plugged", "status": "completed", "tag": "34435ad7-815c-4541-888a-58d96e70159f"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:11.446068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-f140edb5-da36-4fba-bd00-29c84189e43c req-2c4f27be-4f95-438e-abab-ce336f6dee41 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:11.446712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-f140edb5-da36-4fba-bd00-29c84189e43c req-2c4f27be-4f95-438e-abab-ce336f6dee41 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:11.461753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-f140edb5-da36-4fba-bd00-29c84189e43c req-2c4f27be-4f95-438e-abab-ce336f6dee41 service nova] Creating event network-vif-plugged:34435ad7-815c-4541-888a-58d96e70159f for instance e052a589-f2aa-4711-8beb-2171defad99e on hv-cinder-83754 Jun 16 17:35:11.468562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-f140edb5-da36-4fba-bd00-29c84189e43c req-2c4f27be-4f95-438e-abab-ce336f6dee41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036568 Jun 16 17:35:11.470566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 60/122] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:35:11.500184 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:11.508497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f9efcbbb-7705-48a2-9896-73e56ed08a28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.280283 Jun 16 17:35:11.509434 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 63/123] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:11 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:11.519706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:11.520413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:11.526681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:11.527121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:11.527874 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:11.528328 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:11.973545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:11.999365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ebea4835-4a80-4143-844b-74ee13eb54ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.484641 Jun 16 17:35:12.014664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:12.015537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:12.024499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:12.024946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:12.025746 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:12.026944 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 61/124] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:11 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:12.029358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:12.172625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:12.186351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b9bdf05f-086a-4408-9468-6f933668da9f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.175640 Jun 16 17:35:12.187314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 64/125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:12 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:12.526320 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:12.527145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:12.535313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:12.535599 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:12.536378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:12.536919 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:12.691475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:12.699558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-436354a0-4579-4550-a6b0-64aca23c3608 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.177151 Jun 16 17:35:12.700131 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 62/126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:12 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:13.016640 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:13.017414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:13.024140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.024791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.025830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.026469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.204844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:13.205641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:13.214633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.229932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.235019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.238545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.518451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:13.534549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-90a08030-8dcc-4d21-9182-d9d37ebc504d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.522470 Jun 16 17:35:13.535145 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 65/127] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:13 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:13.726377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:13.727098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:13.739589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.739589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.739589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:13.739589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:13.745979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:13.813718 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:13.828799 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b89b3f11-d2a3-4eeb-b1a2-2d00ed3f7560 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.628024 Jun 16 17:35:13.833901 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 63/128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:13 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:13.953228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:13.963125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fe3c5dac-2710-471b-96bf-8782657ac428 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.239675 Jun 16 17:35:13.963125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 66/129] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:13 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:14.265745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2039683-bddc-46c1-a8fd-d25468fda027"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:14.267627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:14.274169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.275228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.276153 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.276772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.284392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2137084476", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "networks": [{"uuid": "bdb07972-a2d5-4a86-97bf-80abf8620cc4"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:14.349932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] validate_networks() for [('bdb07972-a2d5-4a86-97bf-80abf8620cc4', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:35:14.727574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:35:14.728345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:35:14.728962 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:35:14.729393 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:35:14.729822 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:35:14.740435 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.740873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.741762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.742190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.760837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Getting quotas for project 20bf4fe4ecc74735a2abdb5068b0785a. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:35:14.764795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Getting quotas for user 305767c6f53e4239b8c2b209914065eb and project 20bf4fe4ecc74735a2abdb5068b0785a. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:35:14.776624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:35:14.779119 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:35:14.842128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-99eda02a-be6e-45f8-8a47-fc05363ce057 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561709 Jun 16 17:35:14.848470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 67/130] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:35:14.855065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:14.856121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:14.865185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.865492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:14.866376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:14.866819 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.091237 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:15.107170 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-13a40726-d826-4c81-bf38-7061ec1d891e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1363 microversion: 2.1 time: 0.262009 Jun 16 17:35:15.107776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 68/131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:14 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:15.116829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:15.116829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:15.127468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.128340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.129366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.130002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.356696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:15.367807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0257cef9-1949-4509-a28c-1d733620603e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.258556 Jun 16 17:35:15.369116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 69/132] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:15 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:15.377543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c71e5f4d-483e-4d0e-a913-c1b1eaf0002d tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:15.378483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c71e5f4d-483e-4d0e-a913-c1b1eaf0002d tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:15.480464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c71e5f4d-483e-4d0e-a913-c1b1eaf0002d tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:15.494467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c71e5f4d-483e-4d0e-a913-c1b1eaf0002d tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1214 microversion: 2.1 time: 0.123666 Jun 16 17:35:15.495151 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 70/133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:15 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:15.513856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:15.514465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:15.521398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.521857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.522615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:15.523040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:15.666974 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:15.674627 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-697353bd-673d-475a-9a75-41cb3a83e39d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1367 microversion: 2.1 time: 0.167667 Jun 16 17:35:15.675199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 71/134] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:15 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:16.124212 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:16.124611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:16.131704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.132203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.133025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.133542 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.361126 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:16.370021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b694b9ff-b6be-4cf8-9607-25414ab4d773 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1549 microversion: 2.1 time: 0.250122 Jun 16 17:35:16.370969 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 72/135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:16 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:16.391833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:16.392898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:16.396757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:16.400876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.401523 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.402364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.402971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.565823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:16.578291 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-97f44ffa-fc9b-4e2a-8cd3-570f54eba166 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.192709 Jun 16 17:35:16.581475 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 73/136] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:16 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:16.592606 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:16.601821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:16.612196 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.612949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.614077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.614595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.744684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9eccc065-b7e0-4265-9711-5f60d378988c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161935 Jun 16 17:35:16.752701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 74/137] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:35:16 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:16.761021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:16.774166 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:16.798623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.799038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.803430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.804032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.816501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6e0e981a-2e5d-4579-be18-315ab8eccb9b tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "POST /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.553269 Jun 16 17:35:16.818461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 64/138] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:35:14 2022] POST /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148/os-volume_attachments => generated 194 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:16.841494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:16.844966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:16.871075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.873100 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:16.877031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:16.877903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.009314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:17.018874 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-22c00da5-c6e9-4afe-a064-66602b0d52a4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1210 microversion: 2.1 time: 0.270236 Jun 16 17:35:17.027715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 75/139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:16 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1210 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:17.287107 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:17.294034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:17.297231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a657e082-7845-42d5-908f-f9522599f272 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1556 microversion: 2.1 time: 0.476864 Jun 16 17:35:17.300739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 65/140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:16 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1556 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:17.318064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:17.318551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:17.325219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.325909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.326895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.327506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.598445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:17.599061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:17.613211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.616951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.620349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:17.620801 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:17.770804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3ff6539c-968c-47e8-bc35-1a746209cdcd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.457407 Jun 16 17:35:17.777627 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 76/141] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:35:17 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-interface => generated 284 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:18.035236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:18.035855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:18.049105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:18.049855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:18.050656 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:18.051458 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:18.060637 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:18.074958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5e2abad6-0691-4ad0-95bf-ddedead3a8f6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.481675 Jun 16 17:35:18.088271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 66/142] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:17 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:18.192479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:18.211364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5529efb2-28a7-4e56-8cd8-7dcc7ed17532 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1266 microversion: 2.1 time: 0.180491 Jun 16 17:35:18.213143 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 77/143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:18 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:19.096002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:19.097772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:19.106424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:19.108309 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:19.112920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:19.115006 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:19.234316 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:19.234958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:19.246702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:19.247785 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:19.249329 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:19.251947 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:19.499611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:19.508711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3319c0b2-c08d-410b-9a28-834bd4c35597 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1272 microversion: 2.1 time: 0.278782 Jun 16 17:35:19.509323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 78/144] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:19 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:19.661650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:19.682496 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-63800a38-86e6-4a5f-bda4-765b38b0f742 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.591191 Jun 16 17:35:19.686527 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 67/145] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:19 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:19.689016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-a7e9485f-8a83-4519-8733-5c094efa98e8 req-59123665-4c3d-49a5-a510-e3437aa19316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea8edce-fee8-4dbd-ae01-e4d060cf5597", "tag": "4e13aef5-2de9-4312-9c58-333292fceaab"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:19.718612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a7e9485f-8a83-4519-8733-5c094efa98e8 req-59123665-4c3d-49a5-a510-e3437aa19316 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:19.719173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a7e9485f-8a83-4519-8733-5c094efa98e8 req-59123665-4c3d-49a5-a510-e3437aa19316 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:19.738890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-a7e9485f-8a83-4519-8733-5c094efa98e8 req-59123665-4c3d-49a5-a510-e3437aa19316 service nova] Creating event network-changed:4e13aef5-2de9-4312-9c58-333292fceaab for instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 on hv-cinder-83754 Jun 16 17:35:19.746627 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-a7e9485f-8a83-4519-8733-5c094efa98e8 req-59123665-4c3d-49a5-a510-e3437aa19316 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064457 Jun 16 17:35:19.750106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 79/146] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:20.314582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-9735a8c1-c3ae-4ad1-9bbc-0b086d201f85 req-3cfd21c8-130e-4d86-956c-0c56fcd59a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e052a589-f2aa-4711-8beb-2171defad99e", "tag": "34435ad7-815c-4541-888a-58d96e70159f"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:20.331715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9735a8c1-c3ae-4ad1-9bbc-0b086d201f85 req-3cfd21c8-130e-4d86-956c-0c56fcd59a96 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.332512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9735a8c1-c3ae-4ad1-9bbc-0b086d201f85 req-3cfd21c8-130e-4d86-956c-0c56fcd59a96 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.357259 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-9735a8c1-c3ae-4ad1-9bbc-0b086d201f85 req-3cfd21c8-130e-4d86-956c-0c56fcd59a96 service nova] Creating event network-changed:34435ad7-815c-4541-888a-58d96e70159f for instance e052a589-f2aa-4711-8beb-2171defad99e on hv-cinder-83754 Jun 16 17:35:20.376720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-9735a8c1-c3ae-4ad1-9bbc-0b086d201f85 req-3cfd21c8-130e-4d86-956c-0c56fcd59a96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065494 Jun 16 17:35:20.379170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 68/147] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:20.542917 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:20.544976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:20.566112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.566763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.570975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.573180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.706786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:20.708614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:20.727387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:20.741227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-824e4d9a-5712-41bb-b2ad-36b885d52dfc tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1272 microversion: 2.1 time: 0.217391 Jun 16 17:35:20.757804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 80/148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:20 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:20.758140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.759048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:20.760108 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:20.760775 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.185719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:21.222825 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1efcfa55-4ad2-4c25-bb10-1593b327d9c5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.519072 Jun 16 17:35:21.229271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 69/149] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:20 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:21.776082 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:21.777786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:21.786740 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.787780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:21.788905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:21.790620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.118263 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:22.127967 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-49904044-0f27-4f23-bf35-f209170438de tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.360674 Jun 16 17:35:22.139373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 81/150] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:21 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:22.245556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:22.250222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:22.265483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.265923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.266911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.267538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.600618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:22.609434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bd00afee-2d6a-4130-a7f8-9c528b94865d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.369273 Jun 16 17:35:22.611111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 70/151] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:22 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:22.753405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-4c4bfcce-0539-4bff-8ef7-0899a729d94e req-b6802dbc-6fa7-4b50-a344-e60f45da3d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae746d9-78af-453b-97e5-11a3f899b066", "tag": "594c3687-89fc-48db-82bd-7bc8038f52cb"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:22.771441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4c4bfcce-0539-4bff-8ef7-0899a729d94e req-b6802dbc-6fa7-4b50-a344-e60f45da3d09 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:22.771939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4c4bfcce-0539-4bff-8ef7-0899a729d94e req-b6802dbc-6fa7-4b50-a344-e60f45da3d09 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:22.786148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-4c4bfcce-0539-4bff-8ef7-0899a729d94e req-b6802dbc-6fa7-4b50-a344-e60f45da3d09 service nova] Creating event network-changed:594c3687-89fc-48db-82bd-7bc8038f52cb for instance 5ae746d9-78af-453b-97e5-11a3f899b066 on hv-cinder-83754 Jun 16 17:35:22.792916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-4c4bfcce-0539-4bff-8ef7-0899a729d94e req-b6802dbc-6fa7-4b50-a344-e60f45da3d09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054534 Jun 16 17:35:22.794168 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 82/152] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:23.148737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:23.149445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:23.157841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:23.158358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:23.159211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:23.160940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:23.628434 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:23.629170 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:23.640685 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:23.641810 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:23.642586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:23.645205 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:23.805852 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:23.824277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d5d53aa2-d764-4c0c-bf96-f56991bce52f tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.681167 Jun 16 17:35:23.828190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 71/153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:23 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:23.892235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:23.916477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-28a7cf07-c23b-49e6-91e0-8050ee881891 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.292614 Jun 16 17:35:23.937563 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 83/154] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:23 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:24.845201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:24.846013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:24.852480 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=80 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:24.861764 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:24.862341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:24.863132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:24.863568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:24.947117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:24.947794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:24.954588 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:24.957185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:24.957821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:24.958596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:24.959022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:25.065619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:25.076394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-def61fa5-0bc0-4a27-b26a-a7fe70421f7b tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.239177 Jun 16 17:35:25.079761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 72/155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:24 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:25.144749 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:25.176845 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-424d49b5-cbe0-4ce7-92b4-e09fdc954888 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.235214 Jun 16 17:35:25.182752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 84/156] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:24 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:26.097045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:26.097813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:26.104700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:26.105244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:26.106515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:26.107038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:26.199406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:26.200854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:26.206661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=8 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:26.209085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:26.209880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:26.211396 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:26.212059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:26.399245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:26.408431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1cf487b5-9fa1-40b4-b0a5-4ac95e7fc57e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.316407 Jun 16 17:35:26.419156 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 73/157] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:26 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:26.514278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:26.523360 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-40ab5bf9-f2b9-4790-b648-30b5a0f29957 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.328160 Jun 16 17:35:26.533914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 85/158] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:26 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:27.427172 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:27.428340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:27.436298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:27.437135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:27.438106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:27.438832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:27.542771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:27.545098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:27.554214 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:27.556633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:27.557792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:27.558546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:27.582092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:27.765604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:27.782357 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c98e2b5c-6d12-4af5-9bea-3a9884e1cd2a tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.359024 Jun 16 17:35:27.783488 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 74/159] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:27 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:27.863594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:27.872275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8e369511-6d83-4ecf-ac66-c3bc0aa2bded tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.335009 Jun 16 17:35:27.872860 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 86/160] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:27 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:28.039504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:28.042459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:28.054904 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.055364 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.056146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.056579 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.100361 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:35:28.263926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7765bd76-e0ec-468b-b5d1-ef959d997fcc tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "DELETE /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 204 len: 0 microversion: 2.1 time: 0.236962 Jun 16 17:35:28.269084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 75/161] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:28 2022] DELETE /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:35:28.276560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:28.277373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:28.289864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.290962 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.292087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.293961 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.547831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:28.557925 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-858982c5-358d-47c4-818f-cba8f31fae85 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1553 microversion: 2.1 time: 0.287330 Jun 16 17:35:28.558901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 87/162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:28 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:28.803787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:28.807585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:28.821140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.822181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.823953 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.824618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.893710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:28.900962 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:28.904238 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.904956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:28.907048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:28.907626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:29.006267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:29.019219 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-98aa7a4c-325d-4865-ada6-a36255920cb8 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.218733 Jun 16 17:35:29.025832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 76/163] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:28 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:29.118214 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:29.128460 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-56b822f9-74a0-4484-914f-20179401997a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.240426 Jun 16 17:35:29.129249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 88/164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:28 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:29.574915 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:29.575595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:29.582253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:29.582804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:29.583685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:29.584182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:29.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:29.806058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fe072b6d-77e4-49f2-bd6d-e89f16c912ab tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1553 microversion: 2.1 time: 0.234910 Jun 16 17:35:29.806749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 77/165] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:29 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:30.034158 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:30.034931 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:30.041382 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.042025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.043153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.043749 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.106388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-391f445e-e058-46eb-9345-4ece421c5756 req-ae1c486c-68a8-460a-8b8f-7a82f711af5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae746d9-78af-453b-97e5-11a3f899b066", "name": "network-vif-plugged", "status": "completed", "tag": "594c3687-89fc-48db-82bd-7bc8038f52cb"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:30.125052 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-391f445e-e058-46eb-9345-4ece421c5756 req-ae1c486c-68a8-460a-8b8f-7a82f711af5f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.127262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-391f445e-e058-46eb-9345-4ece421c5756 req-ae1c486c-68a8-460a-8b8f-7a82f711af5f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.145017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-391f445e-e058-46eb-9345-4ece421c5756 req-ae1c486c-68a8-460a-8b8f-7a82f711af5f service nova] Creating event network-vif-plugged:594c3687-89fc-48db-82bd-7bc8038f52cb for instance 5ae746d9-78af-453b-97e5-11a3f899b066 on hv-cinder-83754 Jun 16 17:35:30.153642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-391f445e-e058-46eb-9345-4ece421c5756 req-ae1c486c-68a8-460a-8b8f-7a82f711af5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052620 Jun 16 17:35:30.154942 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 78/166] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:30.163724 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:30.164830 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:30.172414 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.173233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.174739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.175396 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.246483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:30.257119 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-709f84d1-ba0a-47dd-bd8a-c826ea13cec7 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.227597 Jun 16 17:35:30.259696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 89/167] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:30 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:30.399587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:30.410400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-977203ec-5625-4d4a-b7aa-968d7a88ee4f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.253764 Jun 16 17:35:30.412686 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 79/168] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:30 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:30.823319 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:30.824802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:30.833198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.833893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:30.834834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:30.835422 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.173201 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:31.184077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bb7ed531-6027-43c4-a0c7-001607507bb2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1553 microversion: 2.1 time: 0.364683 Jun 16 17:35:31.185585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 90/169] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:30 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:31.285026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:31.289486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:31.308032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:31.308480 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.309321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:31.309754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.434385 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:31.435351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:31.444473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:31.445321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.446338 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:31.446980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.656002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:31.667122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cca8d581-fb3d-440e-bd71-b2b12bb2ce92 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1314 microversion: 2.1 time: 0.392908 Jun 16 17:35:31.668346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 80/170] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:31 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:31.813415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:31.824415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-729d0071-414c-4ffd-b672-37876aec7bb8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.393949 Jun 16 17:35:31.825408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 91/171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:31 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:31.899041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-7895aa15-27f0-4e9a-9124-56835a550854 req-2b35d1c4-386d-4763-8ef6-01673294f0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be99b296-6cc1-4b2a-977c-113f47796148", "name": "network-vif-deleted", "tag": "cb17776a-79c0-4129-90a0-ae34814d798c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:31.912135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-7895aa15-27f0-4e9a-9124-56835a550854 req-2b35d1c4-386d-4763-8ef6-01673294f0fb service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:31.912667 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-7895aa15-27f0-4e9a-9124-56835a550854 req-2b35d1c4-386d-4763-8ef6-01673294f0fb service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:31.928000 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-7895aa15-27f0-4e9a-9124-56835a550854 req-2b35d1c4-386d-4763-8ef6-01673294f0fb service nova] Creating event network-vif-deleted:cb17776a-79c0-4129-90a0-ae34814d798c for instance be99b296-6cc1-4b2a-977c-113f47796148 on hv-cinder-83754 Jun 16 17:35:31.933248 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-7895aa15-27f0-4e9a-9124-56835a550854 req-2b35d1c4-386d-4763-8ef6-01673294f0fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041228 Jun 16 17:35:31.934043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 81/172] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:32.208257 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.208876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:32.215264 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.215704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.216472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.216898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.494794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:32.507541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f1e60e20-8604-4647-b86d-84f5c20c6b15 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1511 microversion: 2.1 time: 0.308808 Jun 16 17:35:32.509346 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 92/173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:32.686718 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.688158 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:32.695226 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.695795 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.696680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.697216 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.843377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:32.844861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:32.854511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.855213 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.856831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:32.857757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:32.859815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:32.879596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:32.884825 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a84aaf90-c13f-43a4-882b-c03dfe132a64 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1497 microversion: 2.1 time: 0.203182 Jun 16 17:35:32.885517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 82/174] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:33.096799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:33.104149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-af1ee8f4-715d-4a14-93a1-f0c81f5b13d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.265774 Jun 16 17:35:33.105041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 93/175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:32 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:33.527091 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:33.528035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:33.537487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.537994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.539036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.539482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.576706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.577645 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.579190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lazy-loading 'fault' on Instance uuid be99b296-6cc1-4b2a-977c-113f47796148 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:35:33.633517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe7720ab8b7414a8c336de368ae1ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4537634610c645db8bdb7c704c09ee71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:33.641974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0ebaaa6a-1711-4f70-a4eb-e4dcadffa248 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 200 len: 1304 microversion: 2.1 time: 0.118549 Jun 16 17:35:33.642752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 83/176] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:33 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:33.653321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:33.654399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:33.661743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.662192 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.662964 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.663397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.689927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:35:33.784662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8f759063-652a-4382-a1dd-99b7e82f6774 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 204 len: 0 microversion: 2.1 time: 0.135638 Jun 16 17:35:33.785777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 94/177] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:33 2022] DELETE /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:35:33.794626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:33.795241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:33.801540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.801982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.802924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:33.803348 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:33.946304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:33.954659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4407845c-40c9-4681-8398-54ba6287b76c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1503 microversion: 2.1 time: 0.164212 Jun 16 17:35:33.955325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 84/178] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:33 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:34.122901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:34.123587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:34.131234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.138236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.139089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.139620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.293400 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:34.301879 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5409c1fe-3e24-4592-b2be-82c76cbae934 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.183428 Jun 16 17:35:34.302584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 95/179] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:34 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:34.661238 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:34.662454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:34.673278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.673891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.674961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.675430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.691683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] HTTP exception thrown: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Request method failure captured: Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 HTTP/1.1 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mg3Z_g7PEfpPoRcoT-Fx46LxBZam_Kr08ChlLGpn-slZ06Aoy4kbVEa_vx5wp8bLrICzERDapjwyO7i_zCa0chBdMuH7IJcmUbrYjxHiu3hz3CQWrqGDekPmm3V1A2VLGMnYvX9hqB854YBTeNR4Em2nupuuepIQoWl0BlL-KewFI Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:35:34.696729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4537634610c645db8bdb7c704c09ee71", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4537634610c645db8bdb7c704c09ee71"}]}] Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: cbe7720ab8b7414a8c336de368ae1ec4 Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.698287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'be99b296-6cc1-4b2a-977c-113f47796148'} Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:34.699199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.701001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.702253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Returning 404 to user: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:34.702253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f93c951c-ec9c-44e4-8a47-01cb7860a6f9 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 404 len: 111 microversion: 2.1 time: 0.043006 Jun 16 17:35:34.702253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 85/180] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:34 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:34.808864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:34.810036 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:34.817860 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.818664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.819724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.820477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.835654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] HTTP exception thrown: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Request method failure captured: Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148/os-volume_attachments HTTP/1.1 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mg3Z_g7PEfpPoRcoT-Fx46LxBZam_Kr08ChlLGpn-slZ06Aoy4kbVEa_vx5wp8bLrICzERDapjwyO7i_zCa0chBdMuH7IJcmUbrYjxHiu3hz3CQWrqGDekPmm3V1A2VLGMnYvX9hqB854YBTeNR4Em2nupuuepIQoWl0BlL-KewFI Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:35:34.840619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4537634610c645db8bdb7c704c09ee71", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4537634610c645db8bdb7c704c09ee71"}]}] Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: cbe7720ab8b7414a8c336de368ae1ec4 Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.841897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'server_id': 'be99b296-6cc1-4b2a-977c-113f47796148'} Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:34.842585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:34.844248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:34.845377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Returning 404 to user: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:34.845377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-aefd8469-5380-4791-a787-db74acbf1df2 tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037538 Jun 16 17:35:34.845377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 96/181] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:35:34 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:35:34.975750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:34.976472 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:34.985311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.986019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:34.986856 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:34.987359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:35.148389 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:35.159928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-32e95220-cadc-4bad-b357-277f25f5ae21 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1503 microversion: 2.1 time: 0.190315 Jun 16 17:35:35.165346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 86/182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:34 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:35.321217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:35.322341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:35.329720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:35.330077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:35.330842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:35.331279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:35.475597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:35.485167 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a3ad9653-2701-422e-a313-2f43b9ed88d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.169534 Jun 16 17:35:35.486021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 97/183] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:35 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:36.080882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:36.081456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:36.088046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.088492 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.089304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.089744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.105002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] HTTP exception thrown: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Request method failure captured: Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 HTTP/1.1 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mg3Z_g7PEfpPoRcoT-Fx46LxBZam_Kr08ChlLGpn-slZ06Aoy4kbVEa_vx5wp8bLrICzERDapjwyO7i_zCa0chBdMuH7IJcmUbrYjxHiu3hz3CQWrqGDekPmm3V1A2VLGMnYvX9hqB854YBTeNR4Em2nupuuepIQoWl0BlL-KewFI Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:35:36.106937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4537634610c645db8bdb7c704c09ee71", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4537634610c645db8bdb7c704c09ee71"}]}] Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: cbe7720ab8b7414a8c336de368ae1ec4 Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.108351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'be99b296-6cc1-4b2a-977c-113f47796148'} Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:36.109804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.111520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.112858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Returning 404 to user: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:36.112858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6a79b783-2b35-4e38-9bf4-7e841afd6baf tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "DELETE /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 404 len: 111 microversion: 2.1 time: 0.032250 Jun 16 17:35:36.112858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 87/184] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:35:36 2022] DELETE /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:35:36.119370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:36.120048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] [instance: be99b296-6cc1-4b2a-977c-113f47796148] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:36.127249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.127689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.128439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.128867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.143531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] HTTP exception thrown: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Request method failure captured: Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 HTTP/1.1 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mg3Z_g7PEfpPoRcoT-Fx46LxBZam_Kr08ChlLGpn-slZ06Aoy4kbVEa_vx5wp8bLrICzERDapjwyO7i_zCa0chBdMuH7IJcmUbrYjxHiu3hz3CQWrqGDekPmm3V1A2VLGMnYvX9hqB854YBTeNR4Em2nupuuepIQoWl0BlL-KewFI Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:35:36.145763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4537634610c645db8bdb7c704c09ee71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4537634610c645db8bdb7c704c09ee71", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4537634610c645db8bdb7c704c09ee71"}]}] Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 4537634610c645db8bdb7c704c09ee71 Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983395756 Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: cbe7720ab8b7414a8c336de368ae1ec4 Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-DeleteServersTestJSON-1983395756-project Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.147061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'be99b296-6cc1-4b2a-977c-113f47796148'} Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:36.147798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. Jun 16 17:35:36.149094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:36.150315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] Returning 404 to user: Instance be99b296-6cc1-4b2a-977c-113f47796148 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:36.150315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-05194bbf-c0ff-4aa3-b366-fac3f500a3ec tempest-DeleteServersTestJSON-1983395756 tempest-DeleteServersTestJSON-1983395756-project] 10.222.0.40 "GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148" status: 404 len: 111 microversion: 2.1 time: 0.031869 Jun 16 17:35:36.150315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 98/185] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:36 2022] GET /compute/v2.1/servers/be99b296-6cc1-4b2a-977c-113f47796148 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:36.177454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:36.178066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:36.184086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.184531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.185324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.185757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.506614 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:36.507424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:36.513834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.514293 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.516417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:36.516417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:36.665626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:36.671696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-eeb5b452-4b09-443d-be97-a9a544d2e4ce tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1503 microversion: 2.1 time: 0.498453 Jun 16 17:35:36.672363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 88/186] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:36 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:36.862008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:36.869400 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-97a38627-b77f-40ee-b639-4eff6d32a675 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.367655 Jun 16 17:35:36.869977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 99/187] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:36 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:37.558804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-ada8c204-4fae-42a1-b588-97c9fc16c56c req-9d6fa94f-199c-4a2a-b1c7-c69265daab0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae746d9-78af-453b-97e5-11a3f899b066", "name": "network-vif-deleted", "tag": "594c3687-89fc-48db-82bd-7bc8038f52cb"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:37.568014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ada8c204-4fae-42a1-b588-97c9fc16c56c req-9d6fa94f-199c-4a2a-b1c7-c69265daab0d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:37.568653 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ada8c204-4fae-42a1-b588-97c9fc16c56c req-9d6fa94f-199c-4a2a-b1c7-c69265daab0d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:37.580290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-ada8c204-4fae-42a1-b588-97c9fc16c56c req-9d6fa94f-199c-4a2a-b1c7-c69265daab0d service nova] Creating event network-vif-deleted:594c3687-89fc-48db-82bd-7bc8038f52cb for instance 5ae746d9-78af-453b-97e5-11a3f899b066 on hv-cinder-83754 Jun 16 17:35:37.585000 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-ada8c204-4fae-42a1-b588-97c9fc16c56c req-9d6fa94f-199c-4a2a-b1c7-c69265daab0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029875 Jun 16 17:35:37.585632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 89/188] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:37.690743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:37.691444 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:37.704198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:37.705050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:37.709416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:37.715169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:37.830239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:37.842303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-16b558b4-9a46-4486-8f27-f9c9322d0d3e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1461 microversion: 2.1 time: 0.156487 Jun 16 17:35:37.842892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 100/189] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:37 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:37.887046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:37.888076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:37.896621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:37.897190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:37.897973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:37.898409 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:38.327652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:38.335321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-91f7e5e2-d681-4125-9192-07462f3b5a14 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.452433 Jun 16 17:35:38.335879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 90/190] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:37 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:38.862696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:38.863491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:38.869899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:38.870345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:38.871704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:38.872149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:38.910097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:38.910652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:38.911185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lazy-loading 'fault' on Instance uuid 5ae746d9-78af-453b-97e5-11a3f899b066 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:35:38.980231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:38.990193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2d8d34f3-fb71-4dcf-9e55-44e55e3fa840 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 200 len: 1304 microversion: 2.1 time: 0.133550 Jun 16 17:35:38.990800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 101/191] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:38 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:39.351813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:39.352416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:39.358812 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:39.359960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:39.360964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:39.361424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:39.544643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:39.553876 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1da787f9-056d-45ac-a461-61cdc2c07714 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.205875 Jun 16 17:35:39.557198 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 91/192] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:39 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:40.013697 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:40.014796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 5ae746d9-78af-453b-97e5-11a3f899b066] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:40.034861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:40.036335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:40.037235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:40.037799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:40.292434 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] HTTP exception thrown: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Request method failure captured: Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 HTTP/1.1 Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2nQ4mGcP6GOWlQ8CZXf1LmXpnCCFE2Ht_pUpP3YkivrHAA67OUggFJVaGPdH6EhST9eEExjUwklTvfCHyVRwGUyPYWURffviTSoCIxe-PgQdIKy5kZDWjB22IhUmwEUedDLDi2gyqvcNtLQTw2Yhz90Fs0HGE3TNCuUO1az9dQw2hQ Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 20bf4fe4ecc74735a2abdb5068b0785a Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesActionsTest-9574974 Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:35:40.294066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20bf4fe4ecc74735a2abdb5068b0785a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20bf4fe4ecc74735a2abdb5068b0785a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_20bf4fe4ecc74735a2abdb5068b0785a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/20bf4fe4ecc74735a2abdb5068b0785a"}]}] Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesActionsTest-9574974 Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 20bf4fe4ecc74735a2abdb5068b0785a Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesActionsTest-9574974 Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesActionsTest-9574974-project Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 305767c6f53e4239b8c2b209914065eb Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesActionsTest-9574974-project Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. Jun 16 17:35:40.295363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '5ae746d9-78af-453b-97e5-11a3f899b066'} Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:35:40.296149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. Jun 16 17:35:40.298012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:35:40.299189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Returning 404 to user: Instance 5ae746d9-78af-453b-97e5-11a3f899b066 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:35:40.299189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-94b4a6d2-1d8b-4250-bfc4-c630a0b6db10 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066" status: 404 len: 111 microversion: 2.1 time: 0.287797 Jun 16 17:35:40.307510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 102/193] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:40 2022] GET /compute/v2.1/servers/5ae746d9-78af-453b-97e5-11a3f899b066 => generated 111 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:35:40.444557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1845265912", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "networks": [{"uuid": "bdb07972-a2d5-4a86-97bf-80abf8620cc4"}]}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:40.560820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] validate_networks() for [('bdb07972-a2d5-4a86-97bf-80abf8620cc4', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:35:40.572729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:40.577489 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:40.590431 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:40.591173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:40.592577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:40.594722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:40.613532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:40.883261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:40.893219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ff4190da-0eab-4a2a-9722-08866a907b39 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.326372 Jun 16 17:35:40.897669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 103/194] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:40 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:41.116230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:35:41.116680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:35:41.117230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:35:41.117676 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:35:41.118084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:35:41.131604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:41.132058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:41.132058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:41.132058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:41.151773 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Getting quotas for project 20bf4fe4ecc74735a2abdb5068b0785a. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:35:41.162170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Getting quotas for user 305767c6f53e4239b8c2b209914065eb and project 20bf4fe4ecc74735a2abdb5068b0785a. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:35:41.171291 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:35:41.174145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:35:41.221635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0c43d775-85e5-410e-83bc-270063fba00e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782849 Jun 16 17:35:41.222476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 92/195] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:35:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:35:41.233133 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d43bef44-d0d0-43ab-9486-4139f19d6faa tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:41.233773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d43bef44-d0d0-43ab-9486-4139f19d6faa tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:41.295211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d43bef44-d0d0-43ab-9486-4139f19d6faa tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:41.315798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d43bef44-d0d0-43ab-9486-4139f19d6faa tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1214 microversion: 2.1 time: 0.087041 Jun 16 17:35:41.316900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 104/196] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:41 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:41.913392 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:41.913859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:41.921845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:41.922569 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:41.923469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:41.923908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:42.084308 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:42.092352 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a64ebc15-3369-4321-b19e-6cbc124b0e10 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.184889 Jun 16 17:35:42.092971 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 93/197] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:41 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:42.334398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:42.335097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:42.341098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:42.341700 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:42.342514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:42.343123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:42.430988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:42.440989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-781bdf31-cedd-4dfd-8752-6b867f4186d4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1218 microversion: 2.1 time: 0.110598 Jun 16 17:35:42.441761 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 105/198] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:42 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:43.121114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:43.121755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:43.138569 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:43.139010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:43.139786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:43.140406 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:43.342433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:43.352514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5160d9e1-6dcf-44b5-9516-3b13638c2c87 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.245790 Jun 16 17:35:43.363303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 94/199] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:43 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:43.458957 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:43.460096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:43.466337 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:43.467041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:43.467811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:43.469106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:43.541294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:43.554087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d37ec4a3-148c-4b43-93d4-797313df00cb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1266 microversion: 2.1 time: 0.099068 Jun 16 17:35:43.555430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 106/200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:43 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:44.370336 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:44.371244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:44.382443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:44.383924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:44.385324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:44.387810 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:44.576953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:44.579746 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:44.586847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:44.587669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:44.588455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:44.588902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:44.681712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:44.693808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ad089488-d685-4ee0-9caa-7bc2ea86fa02 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.327449 Jun 16 17:35:44.709662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 95/201] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:44 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:44.714795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:44.723725 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c0158696-1182-43e4-8900-93919e95c9a1 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1272 microversion: 2.1 time: 0.150913 Jun 16 17:35:44.724989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 107/202] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:44 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:45.712043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:45.712565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:45.729056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:45.729555 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:45.730328 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:45.730757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:45.743093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:45.744334 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:45.760128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:45.760848 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:45.762426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:45.763455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:46.259792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:46.264260 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:46.295317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c7a5d51d-9ff8-4778-bb9f-6122aec2aadb tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.555481 Jun 16 17:35:46.298451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 108/203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:45 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:46.299602 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1a275131-e25d-4de9-825e-575170f898d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.591582 Jun 16 17:35:46.311803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 96/204] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:45 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:46.837253 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-6e62cebb-daae-441f-b196-1a1ceaa7a162 req-00593463-efd3-435b-bacc-69c25d941183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11beebef-b030-486a-b8cd-2803da60b484", "tag": "e325070c-6d45-4977-8bd5-51aa2cb6001e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:46.849071 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:46.855081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-6e62cebb-daae-441f-b196-1a1ceaa7a162 req-00593463-efd3-435b-bacc-69c25d941183 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:46.856042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-6e62cebb-daae-441f-b196-1a1ceaa7a162 req-00593463-efd3-435b-bacc-69c25d941183 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:46.880316 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-6e62cebb-daae-441f-b196-1a1ceaa7a162 req-00593463-efd3-435b-bacc-69c25d941183 service nova] Creating event network-changed:e325070c-6d45-4977-8bd5-51aa2cb6001e for instance 11beebef-b030-486a-b8cd-2803da60b484 on hv-cinder-83754 Jun 16 17:35:46.893935 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-6e62cebb-daae-441f-b196-1a1ceaa7a162 req-00593463-efd3-435b-bacc-69c25d941183 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055009 Jun 16 17:35:46.894945 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 109/205] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:35:47.315544 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:47.316943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:47.318879 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:47.319584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:47.326177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:47.327034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:47.329090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:47.329868 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:47.333909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:47.334714 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:47.335583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:47.336216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:47.564790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:47.567633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:47.573430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5fd3fb0e-596d-4c11-89a9-305c1da77ffd tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.263343 Jun 16 17:35:47.574244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 97/206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:47 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:47.589000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4114d3b3-8d4e-48a5-9690-ed26e1ae108f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.273928 Jun 16 17:35:47.589923 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 110/207] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:47 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:47.812976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2be15ac2-72fb-44f1-869e-c8bb865de03e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: .version_select at 0x7f84aa7f3280>, body: {"keypair": {"name": "tempest-keypair-1176793017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFF+QAOHJh2rRDCRaOCvmhGbmCgg2dEW+rOBgwf/V0aDgyrp4xczihqA1kuGoUQi3X3gWjl5EA/QYTkFYUDCLGdampivufyAMOTscvXQ63rL0AnBeRCulTewlI6GQxNSQ=="}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:47.828116 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-2be15ac2-72fb-44f1-869e-c8bb865de03e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:35:47.833413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-2be15ac2-72fb-44f1-869e-c8bb865de03e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for user 2fbaf6d894e64f19bf041e7be20a6242 and project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:35:47.864924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2be15ac2-72fb-44f1-869e-c8bb865de03e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.289323 Jun 16 17:35:47.873386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 98/208] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jun 16 17:35:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 17:35:48.591933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:48.592363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:48.604897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:48.605375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:48.606428 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:48.607089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:48.608420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:48.611047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:48.619052 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:48.619495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:48.620739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:48.621286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:48.945633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:48.953394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:48.955277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8846006f-cf24-4432-b1dd-5a6c28d1ee0c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.352006 Jun 16 17:35:48.956339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 99/209] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:48 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:48.971309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5f9f5d20-629f-495a-b4c4-59e9ccfbfde0 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.383318 Jun 16 17:35:48.972006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:48 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:49.591543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-615618086", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cd693dc-5d6d-482c-a40c-9c9d0ef17994"}], "security_groups": [{"name": "tempest-securitygroup--1197090234"}], "key_name": "tempest-keypair-1176793017", "user_data": "}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:49.710401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] validate_networks() for [('3cd693dc-5d6d-482c-a40c-9c9d0ef17994', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:35:49.979412 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:49.980097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:49.987873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:49.988323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:49.989719 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:49.990155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:50.461323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:50.470859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-89e7398a-bd49-43f4-a02d-f721fc6ca33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.502842 Jun 16 17:35:50.472632 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 112/211] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:49 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:50.506880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:50.507741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:50.517584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:50.518063 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:50.519755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:50.520197 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:50.963051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:35:50.963844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:35:50.964595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:35:50.965559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:35:50.966190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:35:50.980661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:50.982854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:50.984340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:50.985769 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:51.012991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:35:51.018273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for user 2fbaf6d894e64f19bf041e7be20a6242 and project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:35:51.024688 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:51.028274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:51.035877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:35:51.039428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:35:51.040579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3457215d-2770-4894-b9ac-4e0e61586e54 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.566352 Jun 16 17:35:51.042741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 113/212] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:50 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:51.119443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ea00f42e-6d6e-4c7f-8f48-66cd6100d6ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.531640 Jun 16 17:35:51.120575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 100/213] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jun 16 17:35:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 17:35:51.139105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:51.140219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:51.236223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:51.244309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:51.247020 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:51.248645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-182504b8-f73b-4b61-9e4a-0b4ca4b9bf3e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1281 microversion: 2.20 time: 0.121222 Jun 16 17:35:51.249970 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 114/214] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:51 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:51.489798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:51.490839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:51.505773 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:51.506602 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:51.507636 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:51.508290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:51.771625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:51.782593 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0b9a3064-a916-4df4-bdd7-9d07b7409504 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.298551 Jun 16 17:35:51.783466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 101/215] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:51 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:52.059037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:52.059654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:52.065819 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.066266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.067031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.067463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.204154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:52.211527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-17323a3c-293a-477a-8ef5-5417f57845ca tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.156381 Jun 16 17:35:52.212084 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 115/216] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:52 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:52.267135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:52.267742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:52.273910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.274359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.275121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.275557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.336601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:52.345365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:52.346974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:52.348070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-595f3970-016c-42f8-93ad-a21cb45572bd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1285 microversion: 2.20 time: 0.085031 Jun 16 17:35:52.348631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 102/217] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:52 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:52.799533 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:52.800227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:52.806204 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.806843 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.807793 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:52.808399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:52.956769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:52.966159 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fe89a693-22dc-4499-ab47-88758204a520 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.170573 Jun 16 17:35:52.966934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 116/218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:52 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:53.229471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:53.230041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:53.236744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.237620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:53.238121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.238734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:53.259077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:53.366030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:53.366629 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:53.373429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.374200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:53.374893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.375339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:53.378482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:53.385941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-03cb9e4a-3a3f-4dcd-9ba2-01dc6cafd450 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.160497 Jun 16 17:35:53.386733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 103/219] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:53 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:53.438532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:53.446474 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:53.447984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:53.449076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-47ee7557-8dff-4a69-a082-8e28af5f720a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1285 microversion: 2.20 time: 0.087075 Jun 16 17:35:53.449664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 117/220] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:53 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:35:53.984326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:53.984939 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:53.990989 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.991446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:53.992300 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:53.992793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:54.128503 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:54.135935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a86fed73-7d96-42d6-9bf8-faf7225a1796 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.156002 Jun 16 17:35:54.136488 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 104/221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:53 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:54.404259 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:54.404866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:54.411209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:54.411658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:54.412413 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:54.412849 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:54.468553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:54.469179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:54.475705 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:54.476160 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:54.476928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:54.477387 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:54.550924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:54.558846 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:54.560348 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:54.562206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c92becf4-f826-44f3-b88c-fd1526664331 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1285 microversion: 2.20 time: 0.097519 Jun 16 17:35:54.562785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 105/222] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:54 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:35:54.567030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:54.574475 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8743464f-fd96-4d48-a0fc-918cc2e9c206 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.174628 Jun 16 17:35:54.575024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 118/223] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:54 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:55.152598 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:55.153251 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:55.160073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.161354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.162485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.162927 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.314427 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:55.322381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-54b1d9e1-8a20-4f68-845d-d2df748f71d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.173584 Jun 16 17:35:55.322884 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 106/224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:55 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:55.580387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:55.580911 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:55.587154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.587632 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.588394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.588835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.591446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:55.592055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:55.599061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.599509 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.600275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:55.600707 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:55.661231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:55.669087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:55.671190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:55.672301 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c5b82e63-3507-4bd7-a42f-17c2fdca70dd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1333 microversion: 2.20 time: 0.096426 Jun 16 17:35:55.672857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 119/225] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:55 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:55.745469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:55.753089 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-395a579d-3e31-44e7-887d-2ee1928c3f36 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.165444 Jun 16 17:35:55.753978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 107/226] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:55 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:56.343837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:56.345573 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:56.354409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.355009 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.356154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.356813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.500558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:56.508158 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f35c37de-5a23-44f0-9ace-a83baf4756f1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.170053 Jun 16 17:35:56.508734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 120/227] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:56 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:56.692954 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:56.693520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:56.700573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.701017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.701816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.703201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.771042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:56.771647 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:56.777623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.778366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.778807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:56.779234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:56.780358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:56.788433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:56.789968 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:56.791060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e50f5820-730b-4067-9599-5c8e97fbaa4e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1333 microversion: 2.20 time: 0.102928 Jun 16 17:35:56.791616 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 108/228] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:56 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:56.908997 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:56.916421 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8096489a-a894-46c2-86ba-c81b78c6cbd4 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.149210 Jun 16 17:35:56.916984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 121/229] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:56 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:35:57.525598 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:57.526291 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:57.532907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.533377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.534140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.534573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.626897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-4c2bb118-6c1c-4290-9c26-b8b1fe1e3e93 req-3bdd5210-8bef-4299-b9c5-375753db41e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11beebef-b030-486a-b8cd-2803da60b484", "name": "network-vif-plugged", "status": "completed", "tag": "e325070c-6d45-4977-8bd5-51aa2cb6001e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:35:57.636653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4c2bb118-6c1c-4290-9c26-b8b1fe1e3e93 req-3bdd5210-8bef-4299-b9c5-375753db41e4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.637596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-4c2bb118-6c1c-4290-9c26-b8b1fe1e3e93 req-3bdd5210-8bef-4299-b9c5-375753db41e4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.651797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-4c2bb118-6c1c-4290-9c26-b8b1fe1e3e93 req-3bdd5210-8bef-4299-b9c5-375753db41e4 service nova] Creating event network-vif-plugged:e325070c-6d45-4977-8bd5-51aa2cb6001e for instance 11beebef-b030-486a-b8cd-2803da60b484 on hv-cinder-83754 Jun 16 17:35:57.657480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-4c2bb118-6c1c-4290-9c26-b8b1fe1e3e93 req-3bdd5210-8bef-4299-b9c5-375753db41e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Jun 16 17:35:57.658412 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 122/230] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:35:57.676661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:57.684166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fbe61c93-6516-4491-9dee-cfab56d1e120 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.162440 Jun 16 17:35:57.684760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 109/231] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:57 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:57.809347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:57.810053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:57.817524 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.817978 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.818738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.819176 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.823292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:35:57.886823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:57.894862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:57.896394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:57.897521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-07d8267d-62f4-47df-a63e-8fd536d51f7a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1333 microversion: 2.20 time: 0.092430 Jun 16 17:35:57.898081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 123/232] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:57 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:57.933620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:57.934267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:57.941608 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.941983 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:57.942750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:57.943182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:58.072858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:58.080786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cdfaf19a-6b15-460a-980c-91f3eeba3866 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.150872 Jun 16 17:35:58.081609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 110/233] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:57 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:58.700972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:58.701494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:58.708511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:58.709048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:58.709864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:58.710314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:58.848469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:58.856185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7dabd81e-3d01-4061-8d25-4be5c2c488b5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.159153 Jun 16 17:35:58.856765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 124/234] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:58 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:58.915857 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:58.916559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:58.923311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:58.923753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:58.924515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:58.924950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:58.992209 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:59.000896 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:59.002546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:59.003652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d041f8a6-c5a6-4cd6-b788-2b4196067511 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1333 microversion: 2.20 time: 0.091797 Jun 16 17:35:59.004215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 111/235] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:35:58 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:35:59.107908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:59.109219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:59.115283 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:59.115725 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:59.116587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:59.116928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:59.260858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:35:59.270097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-277461ed-1d5c-44b6-9d76-ef1c0ce1d7af tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.166003 Jun 16 17:35:59.270846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 125/236] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:59 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:35:59.874563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:35:59.875162 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:35:59.881218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:59.881657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:35:59.882411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:35:59.882834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:00.024473 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:00.028421 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:00.030681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:00.037621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f7d6f0b7-1a8c-46de-bef5-db656a5ced8b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.166865 Jun 16 17:36:00.041264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 112/237] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:35:59 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:00.047904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:00.049028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:00.049928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:00.050429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:00.116667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:00.126110 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:00.127835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:00.128982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d7abeb35-4869-4232-a753-36f37f3c79f8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1339 microversion: 2.20 time: 0.111458 Jun 16 17:36:00.129583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 126/238] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:00 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:00.289017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:00.289660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:00.295602 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:00.296360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:00.297088 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:00.297553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:00.470265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:00.478906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8c06893d-d9e7-4981-9f01-670521ebed7c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.193625 Jun 16 17:36:00.479573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 113/239] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:00 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:01.056181 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:01.056775 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:01.062989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.063428 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.064176 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.064605 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.147882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:01.148513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:01.150866 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=4 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:01.151657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=16 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:01.160880 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.161372 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.162160 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.162627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.201979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:01.209426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cb7decdb-e035-41b1-9f50-71c6286a4055 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.157067 Jun 16 17:36:01.210014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 127/240] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:01 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:01.300324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:01.308267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:01.309798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:01.310895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-258b4c7d-4710-4fff-b5d7-5a0d2bf8e97a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.167002 Jun 16 17:36:01.311449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 114/241] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:01 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:01.495930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:01.496577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:01.498401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:01.503704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.504152 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.504902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:01.505359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:01.637667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:01.645815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0ed97bf9-4ddb-412b-a471-47b69bbab89e tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.153927 Jun 16 17:36:01.646392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 128/242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:01 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:02.227326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:02.227923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:02.234501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.235147 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.235719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.236146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.329448 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:02.330065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:02.336101 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.336551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.337357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.337796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.365746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:02.373666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fc3fff9f-2028-47f1-810d-b150dc0d69ad tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.149994 Jun 16 17:36:02.374804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 115/243] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:02 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:02.475047 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:02.483265 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:02.485054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:02.486235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e2ec0fed-ade2-4f29-81a7-a5515f8ff107 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.161268 Jun 16 17:36:02.486797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 129/244] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:02 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:02.663367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:02.663892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:02.669955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.670430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.671728 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:02.672166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:02.807821 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:02.815403 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-18f249b4-5c03-4a7c-98b3-225a1a0cc300 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.155978 Jun 16 17:36:02.815973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 116/245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:02 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:03.391871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:03.392432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:03.398565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.399021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.399788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.400262 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.511757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:03.512372 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:03.530355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.530796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.538764 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.542119 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.549120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:03.558225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-228d0b7a-858d-4a2e-a507-5b9f753cbaac tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1522 microversion: 2.1 time: 0.171141 Jun 16 17:36:03.569833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 130/246] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:03 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:03.740703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-db260a4f-e207-4112-a3df-ba805ac6a0a3 req-bf4be88e-7d87-4e37-bd1c-78adcb9d94cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:03.753938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-db260a4f-e207-4112-a3df-ba805ac6a0a3 req-bf4be88e-7d87-4e37-bd1c-78adcb9d94cf service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.754335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-db260a4f-e207-4112-a3df-ba805ac6a0a3 req-bf4be88e-7d87-4e37-bd1c-78adcb9d94cf service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.766514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:03.774147 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-db260a4f-e207-4112-a3df-ba805ac6a0a3 req-bf4be88e-7d87-4e37-bd1c-78adcb9d94cf service nova] Creating event network-changed:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:36:03.782172 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:03.784238 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:03.788365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-099db279-10c9-4b8e-a79e-b355635a52fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.282986 Jun 16 17:36:03.788772 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-db260a4f-e207-4112-a3df-ba805ac6a0a3 req-bf4be88e-7d87-4e37-bd1c-78adcb9d94cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051573 Jun 16 17:36:03.789780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 131/247] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:03.800283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 117/248] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:03 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:03.843657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:03.846875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:03.861074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.861807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:03.863045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:03.863652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.034523 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:04.042216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c867d497-6868-464c-8850-2ad22fba7760 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1314 microversion: 2.1 time: 0.213973 Jun 16 17:36:04.042787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 132/249] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:03 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:04.575782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:04.576412 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:04.583626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.584064 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.584816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.585276 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.734235 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:04.742917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d237cc3a-330d-4585-b28b-8f4a8c931aa9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1502 microversion: 2.1 time: 0.170972 Jun 16 17:36:04.743501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 118/250] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:04 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:04.762123 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:04.762735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:04.769400 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.769854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.770624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.771119 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.817678 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:04.818276 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:04.824102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.824541 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.825500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:04.826083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:04.946332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:04.954870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d2a7235c-1c4e-4743-a868-74c77a08ea1b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1514 microversion: 2.1 time: 0.196477 Jun 16 17:36:04.955392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 133/251] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:04 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:05.014682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:05.024444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:05.028433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:05.030362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8903c307-cd50-4751-8256-772f2462ff8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.215824 Jun 16 17:36:05.031398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 119/252] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:04 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:05.060124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:05.060956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:05.068505 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:05.069509 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:05.071465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:05.071910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:05.296983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:05.331413 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fd812f92-dccb-406e-a253-d682dc7c9bae tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1498 microversion: 2.1 time: 0.273974 Jun 16 17:36:05.333216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 134/253] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:05 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1498 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:05.987166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:05.987732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:05.994470 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:05.995243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:05.996092 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:05.996584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.000930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:06.023870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:36:06.047917 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:06.049933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:06.056637 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.057399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.059113 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.059582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.107918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f1800a3a-6e37-4804-b5f8-7110a7c20a6c tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "DELETE /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 204 len: 0 microversion: 2.1 time: 0.124382 Jun 16 17:36:06.108801 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 120/254] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:36:05 2022] DELETE /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:36:06.117651 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:06.118448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:06.125238 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.125691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.126473 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.126902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.240691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:06.255638 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:06.257925 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:06.259040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-434b05c3-7605-4f4f-a8f4-87e0fa04e689 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.215059 Jun 16 17:36:06.259781 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 135/255] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:06 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:06.292770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:06.300668 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7c0cd0f5-8712-4701-bd1b-ce15c3f70bfe tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1504 microversion: 2.1 time: 0.187387 Jun 16 17:36:06.301459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 121/256] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:06 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:06.440342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:06.441453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:06.448279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.448739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.449544 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.449985 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.474550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'flavor' on Instance uuid b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:36:06.552958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5ffe7240-f99a-4114-aa53-9c2718b50a93 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/action" status: 200 len: 32 microversion: 2.1 time: 0.117968 Jun 16 17:36:06.553590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 136/257] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:36:06 2022] POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:36:06.563099 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:06.563699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:06.569892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.570342 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.571232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:06.571744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:06.704461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:06.712022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-13f37992-cce0-4cf8-9727-81c17ea3d34a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.153340 Jun 16 17:36:06.712790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 122/258] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:06 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:07.278220 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:07.278919 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:07.285872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.286320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.287078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.287507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.317769 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:07.318367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:07.324968 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.325451 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.326215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.327258 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.472422 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:07.484127 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:07.485689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:07.487094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-be22c6a9-3816-4072-b04a-7ffdd51df403 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.213159 Jun 16 17:36:07.497816 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 137/259] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:07 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:07.502703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:07.510047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c7d2dd39-c1b7-4118-a8ab-5ea39c96d007 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1504 microversion: 2.1 time: 0.196034 Jun 16 17:36:07.510615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 123/260] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:07 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:07.729560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:07.730397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:07.737371 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.737821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.738581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:07.739183 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:07.758932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:07.893016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:07.901949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-108e443b-dc94-409d-a226-3b49580cc12a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.176224 Jun 16 17:36:07.902630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 138/261] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:07 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:08.507956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:08.508622 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:08.530838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:08.531470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:08.533026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.534070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.537444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.540589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.540757 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.541231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.542179 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.542837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.823832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:08.835765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cca157b6-ddc5-490f-a122-5e475b50cfee tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1504 microversion: 2.1 time: 0.310472 Jun 16 17:36:08.851220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:08.851979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 139/262] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:08 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:08.860392 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:08.861940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:08.863051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4a6d7506-aece-418a-97b2-bac9190bd004 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.359008 Jun 16 17:36:08.875140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 124/263] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:08 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:08.918888 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:08.919518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:08.928534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.928969 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:08.929854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:08.930288 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.288973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:09.300621 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3de538e0-401c-4e20-a3a9-beac37ea2338 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.385079 Jun 16 17:36:09.301748 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 140/264] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:08 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:09.676251 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-82280623-bf70-400c-b119-cdb44c92badf req-b2694835-3b12-4e1a-9e56-9abde472397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11beebef-b030-486a-b8cd-2803da60b484", "name": "network-vif-deleted", "tag": "e325070c-6d45-4977-8bd5-51aa2cb6001e"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:09.694277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-82280623-bf70-400c-b119-cdb44c92badf req-b2694835-3b12-4e1a-9e56-9abde472397b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.694648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-82280623-bf70-400c-b119-cdb44c92badf req-b2694835-3b12-4e1a-9e56-9abde472397b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.713510 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-82280623-bf70-400c-b119-cdb44c92badf req-b2694835-3b12-4e1a-9e56-9abde472397b service nova] Creating event network-vif-deleted:e325070c-6d45-4977-8bd5-51aa2cb6001e for instance 11beebef-b030-486a-b8cd-2803da60b484 on hv-cinder-83754 Jun 16 17:36:09.720685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-82280623-bf70-400c-b119-cdb44c92badf req-b2694835-3b12-4e1a-9e56-9abde472397b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054011 Jun 16 17:36:09.725686 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 125/265] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:09.854386 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:09.854996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:09.861553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.862007 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.863124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.863567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.893448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:09.894394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:09.898532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.898990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.899472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lazy-loading 'fault' on Instance uuid 11beebef-b030-486a-b8cd-2803da60b484 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:36:09.901621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.902344 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.903352 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:09.903970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:09.962723 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305767c6f53e4239b8c2b209914065eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bf4fe4ecc74735a2abdb5068b0785a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:09.970882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-567bffe6-a07b-4beb-b51d-98ebbcccef28 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 200 len: 1304 microversion: 2.1 time: 0.120341 Jun 16 17:36:09.971864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 141/266] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:09 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:10.083896 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:10.094140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:10.095666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:10.096777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c338ba7a-1663-426e-8a4f-2b32535b5697 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.208742 Jun 16 17:36:10.097360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 126/267] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:09 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:10.317978 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:10.318654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:10.334787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:10.335252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:10.336555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:10.336992 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:10.483595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:10.491693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-277d53f8-4761-4843-8593-c67e157aaac4 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.177513 Jun 16 17:36:10.492282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 142/268] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:10 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:10.686282 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-b512176e-ca1a-4ad6-b1d4-b1e4d1c5c9f4 req-79ca6a8f-8a72-44ef-819d-5873bc7fc658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "name": "network-vif-plugged", "status": "completed", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:10.700590 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b512176e-ca1a-4ad6-b1d4-b1e4d1c5c9f4 req-79ca6a8f-8a72-44ef-819d-5873bc7fc658 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:10.701013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b512176e-ca1a-4ad6-b1d4-b1e4d1c5c9f4 req-79ca6a8f-8a72-44ef-819d-5873bc7fc658 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:10.716422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-b512176e-ca1a-4ad6-b1d4-b1e4d1c5c9f4 req-79ca6a8f-8a72-44ef-819d-5873bc7fc658 service nova] Creating event network-vif-plugged:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:36:10.722424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-b512176e-ca1a-4ad6-b1d4-b1e4d1c5c9f4 req-79ca6a8f-8a72-44ef-819d-5873bc7fc658 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Jun 16 17:36:10.723261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 127/269] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:10.988698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:10.989946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] [instance: 11beebef-b030-486a-b8cd-2803da60b484] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:11.005293 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.005855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.006783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.008174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.023959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] HTTP exception thrown: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Request method failure captured: Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 HTTP/1.1 Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2nQ4mGcP6GOWlQ8CZXf1LmXpnCCFE2Ht_pUpP3YkivrHAA67OUggFJVaGPdH6EhST9eEExjUwklTvfCHyVRwGUyPYWURffviTSoCIxe-PgQdIKy5kZDWjB22IhUmwEUedDLDi2gyqvcNtLQTw2Yhz90Fs0HGE3TNCuUO1az9dQw2hQ Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 20bf4fe4ecc74735a2abdb5068b0785a Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesActionsTest-9574974 Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:36:11.026044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20bf4fe4ecc74735a2abdb5068b0785a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/20bf4fe4ecc74735a2abdb5068b0785a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_20bf4fe4ecc74735a2abdb5068b0785a", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/20bf4fe4ecc74735a2abdb5068b0785a"}]}] Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesActionsTest-9574974 Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 20bf4fe4ecc74735a2abdb5068b0785a Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesActionsTest-9574974 Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesActionsTest-9574974-project Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 305767c6f53e4239b8c2b209914065eb Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesActionsTest-9574974-project Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. Jun 16 17:36:11.027308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '11beebef-b030-486a-b8cd-2803da60b484'} Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:36:11.028028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. Jun 16 17:36:11.029229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:36:11.032467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] Returning 404 to user: Instance 11beebef-b030-486a-b8cd-2803da60b484 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:36:11.033728 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a9e88413-8424-4fa7-9231-8ab89d6423a2 tempest-VolumesActionsTest-9574974 tempest-VolumesActionsTest-9574974-project] 10.222.0.40 "GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484" status: 404 len: 111 microversion: 2.1 time: 0.049214 Jun 16 17:36:11.034845 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 143/270] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:10 2022] GET /compute/v2.1/servers/11beebef-b030-486a-b8cd-2803da60b484 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:36:11.115037 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:11.116041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:11.122591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.123040 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.123861 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.124293 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.338485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:11.352142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:11.355632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:11.357047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a9774a6d-5637-4ab0-940c-329ebbbdf5ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.245932 Jun 16 17:36:11.358568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 128/271] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:11 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:36:11.510311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:11.511678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:11.519253 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.519809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.521035 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:11.521761 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:11.693081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:11.702392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d33a83dc-3240-41d2-a024-7d1e40b14dff tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.196051 Jun 16 17:36:11.702987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 144/272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:11 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:12.376694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:12.377504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:12.385973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.386295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:12.387097 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.387533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:12.595978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:12.604782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:12.606355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:12.607467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-64ab7bab-73fb-4928-a170-e863913b2ce2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.235414 Jun 16 17:36:12.608070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 129/273] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:12 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:12.720317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:12.720954 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:12.726952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.727401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:12.728173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:12.728610 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:12.868796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:12.876844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b4ad6176-aa01-4931-9b1b-2f7245f5717c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.161667 Jun 16 17:36:12.877496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 145/274] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:12 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:13.626216 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:13.626819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:13.633246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:13.633685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:13.634438 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:13.634875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:13.774696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:13.783765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:13.785297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:13.786400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5010575f-3974-4aef-bf8d-f93e3f0f97a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.164469 Jun 16 17:36:13.786968 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 130/275] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:13 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:13.893439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:13.894047 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:13.900179 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:13.900628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:13.901418 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:13.901860 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:14.043966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:14.055129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-52ac583d-4fb7-4f75-82c2-8821bd191093 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.165561 Jun 16 17:36:14.055900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 146/276] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:13 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:14.806257 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:14.807075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:14.815202 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:14.815659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:14.816685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:14.817515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:14.946307 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:14.956597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:14.958281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:14.959366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bb8e2217-b7a7-47ab-ba52-6512a3584cba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1407 microversion: 2.20 time: 0.157472 Jun 16 17:36:14.959948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 131/277] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:14 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:15.072727 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:15.073368 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:15.080269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.080713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:15.081512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.081946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:15.214217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:15.221865 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c94f90cf-144e-4c50-96d5-8e9615d37fa2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.153030 Jun 16 17:36:15.222433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 147/278] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:15 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:15.976950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:15.977615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:15.984982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.985437 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:15.986405 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:15.986837 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.126228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:16.134156 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:16.135665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:16.136804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-170a7b4f-7c04-42a3-9a68-f917238f2691 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1599 microversion: 2.20 time: 0.163745 Jun 16 17:36:16.137408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 132/279] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:36:15 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:36:16.155828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:16.156352 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:16.162281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.162726 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.163516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.163978 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.247104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:16.247713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:16.257742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.258508 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.259526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:16.260293 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:16.285806 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1cdd80b4-fdaa-41da-91dd-cd99fece5062 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133229 Jun 16 17:36:16.286832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 148/280] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jun 16 17:36:16 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:36:16.612178 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:16.631417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d3971f52-6148-4cbb-b1b8-33f768b4ad56 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.387602 Jun 16 17:36:16.633296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 133/281] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:16 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:17.652037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:17.653081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:17.665878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:17.666481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:17.675417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=84 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:17.692130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.695618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.696162 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.697958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.698680 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.700206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.700900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:17.704514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:17.757929 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b274893c-f15b-4029-8c0b-b2698326ac1c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/ips" status: 200 len: 149 microversion: 2.1 time: 0.099857 Jun 16 17:36:17.759254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 134/282] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:36:17 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/ips => generated 149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:18.069703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:18.079094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-96d176ac-e8e9-44cb-a05d-6610c3da180d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.431580 Jun 16 17:36:18.083136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 149/283] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:17 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:18.200934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-f5ef105f-86d5-4b8d-a48b-4d2f7841cd3c req-1736297b-c196-4736-b867-91007078b267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:18.222075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-f5ef105f-86d5-4b8d-a48b-4d2f7841cd3c req-1736297b-c196-4736-b867-91007078b267 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:18.223077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-f5ef105f-86d5-4b8d-a48b-4d2f7841cd3c req-1736297b-c196-4736-b867-91007078b267 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:18.253471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-f5ef105f-86d5-4b8d-a48b-4d2f7841cd3c req-1736297b-c196-4736-b867-91007078b267 service nova] Creating event network-changed:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:36:18.267045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-f5ef105f-86d5-4b8d-a48b-4d2f7841cd3c req-1736297b-c196-4736-b867-91007078b267 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074906 Jun 16 17:36:18.268417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 135/284] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:19.098953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:19.101777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:19.121835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:19.125677 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:19.128895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:19.129699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:19.379658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:19.392840 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3bcf5e81-b0a9-4d19-a36d-972aac95c0e5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.298498 Jun 16 17:36:19.394430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 150/285] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:19 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:19.516287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d06d388-dd76-47d4-bd03-fd3d683e51bf"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:19.517619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:19.529574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:19.530641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:19.537334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:19.537797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.000623 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:20.060570 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-81b890e0-2b23-42c5-b00f-231ad7984f76 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552829 Jun 16 17:36:20.066425 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 136/286] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:36:19 2022] POST /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:36:20.423699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:20.426952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:20.444949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.445454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.446240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:20.448209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:20.663361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:20.675743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-923205a9-e511-4521-b6b9-2c3abbc1e1d1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.256910 Jun 16 17:36:20.676453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 151/287] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:20 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:21.698061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:21.700449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:21.704288 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:21.711863 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:21.712316 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:21.713094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:21.713574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:21.882779 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:21.891210 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-05c5a0ca-9dc7-4fa4-a9c5-84eebd556dbf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.197899 Jun 16 17:36:21.892121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 137/288] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:21 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:22.915126 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:22.915734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:22.923005 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:22.923459 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:22.924242 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:22.924681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:23.099241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:23.108834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-be387f5d-209c-48d7-b381-bb5635b1d33c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.198328 Jun 16 17:36:23.109788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 152/289] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:22 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:24.130455 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:24.133500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:24.140798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:24.141564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:24.142563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:24.142995 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:24.298253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:24.306470 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-038b0c95-007e-4b4c-856c-c51277b02091 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.179804 Jun 16 17:36:24.307106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 138/290] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:24 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:25.324429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:25.326008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:25.332941 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:25.333514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:25.334299 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:25.334731 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:25.522527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:25.537452 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ee8277ce-30da-4b2e-acfb-d0c468150d68 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.216904 Jun 16 17:36:25.538222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 153/291] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:25 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:26.091817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:26.093080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:26.100141 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.100605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.101539 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.102185 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.130444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6cc85eb4-bb9c-435d-b5ef-e7d0c4a60765 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/ips" status: 200 len: 145 microversion: 2.1 time: 0.043144 Jun 16 17:36:26.131941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 139/292] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:36:26 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:26.558980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:26.559921 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:26.586573 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.589033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.590158 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:26.594774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:26.814706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:26.832527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-857d08cc-ffad-416c-bf37-232b0d479f51 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.279699 Jun 16 17:36:26.844946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 154/293] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:26 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:27.862672 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:27.865072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:27.876002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:27.876806 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:27.877938 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:27.878559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:28.096316 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:28.104378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-94d77c9f-6871-41f7-84fa-1bd515c64efe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.255597 Jun 16 17:36:28.115031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 140/294] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:27 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:28.678340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522899a8-9f5b-4135-82ce-99d3a0b88e43"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:28.682582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:28.690479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:28.691107 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:28.694641 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:28.696353 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:28.844622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:29.125330 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:29.127330 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:29.141205 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:29.143030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:29.145844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:29.146783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:29.159831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-73c506a1-735d-4352-8c64-a2c123e88818 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489286 Jun 16 17:36:29.161245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 155/295] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:36:28 2022] POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:29.466043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:29.488997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b35e9dd7-2bd3-43d6-993f-13b22397bfe2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.370494 Jun 16 17:36:29.509471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 141/296] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:29 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:30.516335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:30.517883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:30.535008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:30.537816 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:30.539335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:30.540174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:31.020675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:31.046977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-99bb686c-c8bd-4600-bcfc-d55cb81e7f6c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.535594 Jun 16 17:36:31.051898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 156/297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:30 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:31.210721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-daca1895-b944-401a-9219-820b6ca2782d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: .version_select at 0x7f84aa59c040>, body: {"keypair": {"name": "tempest-keypair-622175028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZilnk79ahnIC82dRh0e9g4sJKUyclws5ccPQniecQozVi4lh8I9Z03HpoaLaBxerrODVdf+s/fmJtkxLw4Yc2OELtkp2T7PKaaBBeYUmpUjuZbvbUfALLQ2by36VZj7A=="}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:31.233850 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-daca1895-b944-401a-9219-820b6ca2782d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:31.257244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-daca1895-b944-401a-9219-820b6ca2782d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:31.309284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-daca1895-b944-401a-9219-820b6ca2782d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103939 Jun 16 17:36:31.314134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 142/298] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:36:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:32.068102 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:32.069490 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:32.082604 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:32.083258 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:32.084118 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:32.086545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:32.406121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:32.414330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a34a6486-d468-4b6a-ac70-48d5fb0e6cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.350672 Jun 16 17:36:32.422418 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 157/299] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:32 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:33.443826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:33.445505 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:33.461665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:33.462135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:33.470787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:33.471469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:33.804748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:33.816979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-434a0a11-f47c-4241-a769-56f4081b2e28 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.382788 Jun 16 17:36:33.820289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 143/300] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:33 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:34.203994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1662111554", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb674c9-6bb7-4c32-892c-b28837e89812"}], "security_groups": [{"name": "tempest-securitygroup--1988023170"}], "key_name": "tempest-keypair-622175028", "user_data": "}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:34.840132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:34.841081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:34.861250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:34.864004 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:34.867693 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:34.868333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:35.307704 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:35.320483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aad459ce-ce7c-4fe4-b071-75fd2ad3bc6a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.486522 Jun 16 17:36:35.321448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 144/301] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:34 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:36.350845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:36.352725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:36.383040 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.384073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.385608 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:36.386383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:36.613198 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:36.623357 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d343717b-82d5-4c1f-8607-4778bb697a30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.285547 Jun 16 17:36:36.624026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 145/302] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:36 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:37.640771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:37.645180 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:37.657904 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:37.669168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:37.671170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:37.671779 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:38.022242 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:38.037247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9591c11b-ed5d-4726-bbf4-94c65ae588dc tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.401125 Jun 16 17:36:38.038128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 146/303] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:37 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:38.316362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9ffbaf70-22dd-4bf0-819a-7978dd7fc0bf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:38.332989 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffbaf70-22dd-4bf0-819a-7978dd7fc0bf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:38.333500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffbaf70-22dd-4bf0-819a-7978dd7fc0bf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:38.488106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9ffbaf70-22dd-4bf0-819a-7978dd7fc0bf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Going to try to stop instance {{(pid=124160) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:36:38.558724 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9ffbaf70-22dd-4bf0-819a-7978dd7fc0bf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action" status: 202 len: 0 microversion: 2.1 time: 0.247152 Jun 16 17:36:38.581833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 147/304] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:36:38 2022] POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:36:38.581833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:38.581833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:38.581833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:38.582163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:38.582163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:38.582163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:39.035493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:39.050512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7e6c8e69-94d0-4784-8265-b53cb4558ecb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.485336 Jun 16 17:36:39.051104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 148/305] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:38 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:39.065517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:39.066246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:39.076194 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:39.077321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:39.078907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:39.079668 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:39.128027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] validate_networks() for [('6fb674c9-6bb7-4c32-892c-b28837e89812', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:36:39.454637 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:39.484082 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6d0f7000-0878-42db-b65f-f2cda018bdfd tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.411229 Jun 16 17:36:39.490017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 149/306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:39 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:39.976178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:36:39.977165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:36:39.978083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:36:39.978872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:36:39.979427 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:36:40.000940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.001432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.002234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.002662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.050691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:40.059137 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:40.068833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:40.070660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:40.081483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.086987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.087995 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:40.089940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:40.147525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:36:40.151295 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:36:40.271211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4655a633-b920-48a8-8828-0463e4d3848d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.071969 Jun 16 17:36:40.272184 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 158/307] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:36:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 6075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:36:40.304293 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9617edc5-af51-4321-acab-497cf156fc3d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:40.305609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9617edc5-af51-4321-acab-497cf156fc3d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:40.976545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9617edc5-af51-4321-acab-497cf156fc3d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:40.994344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9617edc5-af51-4321-acab-497cf156fc3d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1241 microversion: 2.1 time: 0.700546 Jun 16 17:36:40.994952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 159/308] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:40 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1241 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:41.009412 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:41.010745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:41.022420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:41.023065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:41.033056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:41.034951 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:41.282430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=4 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:41.362839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:41.368205 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:41.381558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eae311da-adad-4cd1-b0f9-22a646c243f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.384883 Jun 16 17:36:41.382337 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 160/309] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:40 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:41.387725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c55ae331-cfcf-4235-8eb2-2bda5370e10d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 1.323575 Jun 16 17:36:41.399361 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 150/310] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:40 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:42.021898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:42.022981 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:42.039778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.043217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.046883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.049949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.184218 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:42.193917 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ca5e5d89-ac18-4851-a90d-3556b4cf0cbd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1293 microversion: 2.1 time: 0.181560 Jun 16 17:36:42.195072 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 161/311] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:42 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:42.402349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:42.403327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:42.414831 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.415532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.416534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.420617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:42.421129 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.422466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:42.434321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.435179 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.436464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.442872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.733230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:42.742468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-67c502e4-e69e-4742-bd8b-a821f3b27cce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1500 microversion: 2.1 time: 0.344220 Jun 16 17:36:42.744360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 151/312] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:42 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1500 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:42.760421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bbffa4b-6a42-41d2-8aad-7098e4152b11"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:42.761845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:42.768918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.769385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.770346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.770791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.800939 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] HTTP exception thrown: Cannot 'attach_volume' instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 while it is in vm_state rescued Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Request method failure captured: Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/os-volume_attachments HTTP/1.1 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 74 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mfxyiT9WKfMSFPJaojSJe8--KXr7L7nqmAZJmt-eZ_rxN89uFYZ0s6ZwdSHtzILeQt26Vf1ANnb3FFotcJOYeL-jRg_JylhkFBvmCZUCGzhTQzKL4EJm7iJTBTm1HJYlbP83QdnrK1lJ9Bib2x46YrqsGnqvZoLRiBixNANE2nYZ0 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:36:42.803501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1c1d13142434356ac1210f14dad847b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1c1d13142434356ac1210f14dad847b"}]}] Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: a5c37b79bf3d40f4a6182cc296585c18 Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {"volumeAttachment": {"volumeId": "4bbffa4b-6a42-41d2-8aad-7098e4152b11"}} Jun 16 17:36:42.804858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Cannot 'attach_volume' instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 while it is in vm_state rescued Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'server_id': 'b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69', 'body': {'volumeAttachment': {'volumeId': '4bbffa4b-6a42-41d2-8aad-7098e4152b11'}}} Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:36:42.805732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 while it is in vm_state rescued Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:36:42.806914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:36:42.808111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:36:42.808111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:36:42.808111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 while it is in vm_state rescued Jun 16 17:36:42.808111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:36:42.812493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Returning 409 to user: Cannot 'attach_volume' instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 while it is in vm_state rescued {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:36:42.813700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ac1bd4f8-4328-4157-95a7-2d0fbadc821e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057296 Jun 16 17:36:42.818106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 152/313] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:36:42 2022] POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 17:36:42.818862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:42.823872 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:42.824632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:42.831365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bc70c4d2-8391-4960-a428-bb03de80fb43 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.416131 Jun 16 17:36:42.831768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.832533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.833360 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 162/314] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:42 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:42.843414 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:42.843873 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:42.879574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:43.006246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-07be98e1-0730-4498-b670-7017c2faf68c tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/action" status: 202 len: 0 microversion: 2.1 time: 0.184726 Jun 16 17:36:43.007515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 153/315] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:36:42 2022] POST /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:36:43.015879 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:43.016630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:43.032769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.033234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:43.034234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.034861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:43.213054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:43.213870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:43.226795 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.228316 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:43.251881 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.255450 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:43.419532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:43.429530 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-733766d7-2a60-43c3-bf99-d940e37bcb6e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1299 microversion: 2.1 time: 0.220026 Jun 16 17:36:43.439102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 154/316] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:43 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:43.524441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:43.553061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-23afe54f-5fde-4c05-b074-199b4cabfaaf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1508 microversion: 2.1 time: 0.540288 Jun 16 17:36:43.556062 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 163/317] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:43 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:43.860323 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:43.861604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:43.897666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.914865 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:43.915976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:43.916568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:44.321959 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:44.334949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-526c623f-55b8-4743-8e2d-925cbb8530bc tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.487969 Jun 16 17:36:44.340201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 155/318] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:43 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:44.446571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:44.447189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:44.455269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:44.455722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:44.456504 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:44.456942 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:44.572908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:44.573643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:44.585750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:44.586221 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:44.587001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:44.587620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:45.176574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:45.194618 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4987b7d6-84e0-423a-9b00-48fb39542fbc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.751856 Jun 16 17:36:45.202927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 164/319] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:44 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:45.304552 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:45.312509 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e705bb1f-6aef-4211-a75f-32f21f35955b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1508 microversion: 2.1 time: 0.743386 Jun 16 17:36:45.322561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 156/320] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:44 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1508 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:45.360439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:45.361060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:45.371218 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:45.372424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:45.373558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:45.374657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:45.405234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-45f47aad-97e8-4671-b376-c21c3dec47ea req-2803af78-d72b-4b10-bf7a-e34b1858a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb", "tag": "42876d97-ab72-447f-9723-b8c55e7cd05c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:45.427665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-45f47aad-97e8-4671-b376-c21c3dec47ea req-2803af78-d72b-4b10-bf7a-e34b1858a3b0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:45.428463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-45f47aad-97e8-4671-b376-c21c3dec47ea req-2803af78-d72b-4b10-bf7a-e34b1858a3b0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:45.447296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-45f47aad-97e8-4671-b376-c21c3dec47ea req-2803af78-d72b-4b10-bf7a-e34b1858a3b0 service nova] Creating event network-changed:42876d97-ab72-447f-9723-b8c55e7cd05c for instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb on hv-cinder-83754 Jun 16 17:36:45.468778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-45f47aad-97e8-4671-b376-c21c3dec47ea req-2803af78-d72b-4b10-bf7a-e34b1858a3b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068952 Jun 16 17:36:45.469441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 157/321] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:45.690270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:45.712612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-42e940ab-4792-432d-b2b0-4ae5008163a3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.356830 Jun 16 17:36:45.713814 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 165/322] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:45 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:46.242662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:46.243830 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:46.261077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.261564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.262358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.263534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.497667 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:46.502927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5f3ad814-3f76-46bf-b37d-3a3b28476e51 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Action: 'create', calling method: .version_select at 0x7f84aa77f430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-489756062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuhEmjoOCIuJeSeby3qy2s2ulXIGx/G0g/DJJvGIrOY1jIjXzR1a+CvvPg53azb6RanxMvnmgP0mA2a34XKoEEDbCb0sOGEbwHpn74pCjwcbM5XhccpAbaw4OAHSNL32g=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:46.506791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bba08b91-cca1-4ed6-9517-6a39a46847ff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.282005 Jun 16 17:36:46.518270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 158/323] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:46 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:46.520240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-5f3ad814-3f76-46bf-b37d-3a3b28476e51 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:46.525051 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-5f3ad814-3f76-46bf-b37d-3a3b28476e51 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for user faf0a0102da24cedaedd0c67273e275b and project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:46.525264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:46.525969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:46.534411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.534968 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.535816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.536366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.558732 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5f3ad814-3f76-46bf-b37d-3a3b28476e51 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.333859 Jun 16 17:36:46.559515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 166/324] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:36:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:46.730952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:46.732292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:46.739018 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.739459 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.740225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:46.740657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:46.766157 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:46.775885 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-524c1d98-f401-450c-8366-52e37158f5b9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1508 microversion: 2.1 time: 0.255856 Jun 16 17:36:46.780945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 159/325] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:46 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:46.980629 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:46.993770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-efd4351b-98fd-46b7-bbd6-bbb1dfe7eddb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.266287 Jun 16 17:36:47.005244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 167/326] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:46 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:47.527939 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:47.529143 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:47.536560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:47.537327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:47.538050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:47.538674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:47.760597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:47.769458 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-71eb2e25-7208-484a-b52d-648c67f2d3e2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.245256 Jun 16 17:36:47.780673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 160/327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:47 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:47.795899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:47.796562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:47.800148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:47.810377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:47.810953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:47.811759 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:47.812201 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:48.016151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:48.017848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:48.025784 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:48.026558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:48.028125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:48.032125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:48.176692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:48.187838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5b8536b3-625a-42f1-9379-cc6525549b0a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1514 microversion: 2.1 time: 0.395886 Jun 16 17:36:48.198663 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 168/328] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:47 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:48.344820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:48.374657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9fca0086-79f2-4d64-a506-ef5b7d7e8cbd tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.366663 Jun 16 17:36:48.387374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 161/329] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:48 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:48.788999 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:48.789660 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:48.825684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:48.826359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:48.827966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:48.828619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:49.131825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:49.145870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7ae1dc25-4dad-4c56-ac2b-1f29b9d38c06 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.361893 Jun 16 17:36:49.155328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 169/330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:48 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:49.412663 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:49.412663 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:49.423831 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:49.426002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:49.427145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:49.428047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:49.763936 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:49.793702 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-178049ba-41da-4eda-ab12-aeb790ba8822 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.392345 Jun 16 17:36:49.794987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 162/331] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:49 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:49.970440 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b504106c-9580-465b-b682-ee1e3e782138 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: .version_select at 0x7f84aa50fee0>, body: {"keypair": {"name": "tempest-keypair-1963321092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFjQTurBRD6MiHZVfoufl/1D7Yd5a9aR6Rr8wmYeSCIF5deOtj5J0tYYlt/+7g2tAUHuEpdTFN+zKJtnDpMfFcscxHrMZdqX1pTwZo8aI4wC3M9tMlTA+HZsLny3/gZQw=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:50.008908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-b504106c-9580-465b-b682-ee1e3e782138 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for project d1c1d13142434356ac1210f14dad847b. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:50.019923 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:50.030376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-b504106c-9580-465b-b682-ee1e3e782138 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for user a5c37b79bf3d40f4a6182cc296585c18 and project d1c1d13142434356ac1210f14dad847b. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:50.091632 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b504106c-9580-465b-b682-ee1e3e782138 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124789 Jun 16 17:36:50.092377 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 170/332] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:36:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:50.168507 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:50.169605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:50.192280 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:50.196406 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:50.198420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:50.198868 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:50.610204 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:50.640902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-24d6ef04-2a8c-4e6d-8990-d480b98d0c5b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.482319 Jun 16 17:36:50.645248 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 163/333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:50 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:50.812792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:50.813436 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:50.835155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:50.835608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:50.836397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:50.836829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:51.091956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:51.103342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1a347854-fc40-44be-8f0c-8a1a9836075b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.295303 Jun 16 17:36:51.104174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 171/334] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:50 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:51.658460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:51.659149 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:51.672659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:51.673483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:51.674284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:51.674726 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:52.111960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:52.125080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:52.127368 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:52.142141 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-612516e8-371e-4678-ae59-69a81d0a5dc4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.487769 Jun 16 17:36:52.145719 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:52.146707 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 164/335] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:51 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:52.147465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:52.148851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:52.149492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:52.405345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:52.417493 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-453d7a55-3759-42b0-bada-12f8e1aa57aa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.298522 Jun 16 17:36:52.418873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 172/336] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:52 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:53.165574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:53.166858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:53.175337 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:53.179836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:53.180471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:53.182902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:53.184770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:53.364039 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-641145556", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd7b32b9-764e-43c1-a67e-f0e3f862c460"}], "security_groups": [{"name": "tempest-securitygroup--551170364"}], "key_name": "tempest-keypair-1963321092", "user_data": "}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:53.412918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:53.423567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9ffb15e1-a080-4054-b474-1510a80ab0bd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.263011 Jun 16 17:36:53.424164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 165/337] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:53 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:53.444016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:53.444588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:53.458634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:53.459156 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:53.460090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:53.460367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:53.593480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] validate_networks() for [('dd7b32b9-764e-43c1-a67e-f0e3f862c460', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:36:53.745252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:53.764796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f7a2c6cf-f263-4b7d-a639-ab8bf66e350a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1723 microversion: 2.1 time: 0.330389 Jun 16 17:36:53.775146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 166/338] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:53 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:54.132691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:36:54.133226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:36:54.134981 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:36:54.135406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:36:54.135837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:36:54.171862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.189938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:54.190856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.193628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:54.255243 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:36:54.265771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Getting quotas for user a5c37b79bf3d40f4a6182cc296585c18 and project d1c1d13142434356ac1210f14dad847b. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:36:54.289742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:36:54.292636 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:36:54.367662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6d928ca3-9b2f-46a4-baee-67fde40bcadf tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.007803 Jun 16 17:36:54.368828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 173/339] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:36:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:36:54.381952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aaeadaae-88af-4d45-a24a-7be13121d528 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:54.382781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aaeadaae-88af-4d45-a24a-7be13121d528 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:54.444148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:54.444891 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:54.459481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.459945 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:54.460696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.461135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:54.476844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aaeadaae-88af-4d45-a24a-7be13121d528 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:54.485284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aaeadaae-88af-4d45-a24a-7be13121d528 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1245 microversion: 2.1 time: 0.108359 Jun 16 17:36:54.487037 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 167/340] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:54 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:54.700105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:54.721658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a28ed5bc-66a8-4e07-a7bd-5cc4fc763cc7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.284221 Jun 16 17:36:54.723403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 174/341] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:54 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:54.782874 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:54.783477 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:54.792755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.793130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:54.794525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:54.794961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.086879 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-a474c3bf-e325-45d5-9851-bb3f615130dd req-cfa285f5-7046-4ced-b183-32ea253a2741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb", "name": "network-vif-plugged", "status": "completed", "tag": "42876d97-ab72-447f-9723-b8c55e7cd05c"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:55.117692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a474c3bf-e325-45d5-9851-bb3f615130dd req-cfa285f5-7046-4ced-b183-32ea253a2741 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.119592 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a474c3bf-e325-45d5-9851-bb3f615130dd req-cfa285f5-7046-4ced-b183-32ea253a2741 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.156409 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:55.160912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-a474c3bf-e325-45d5-9851-bb3f615130dd req-cfa285f5-7046-4ced-b183-32ea253a2741 service nova] Creating event network-vif-plugged:42876d97-ab72-447f-9723-b8c55e7cd05c for instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb on hv-cinder-83754 Jun 16 17:36:55.165677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9f20d1e1-2d83-4949-821e-cd488657dc16 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1700 microversion: 2.1 time: 0.386943 Jun 16 17:36:55.166473 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 168/342] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:54 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1700 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:55.171026 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-a474c3bf-e325-45d5-9851-bb3f615130dd req-cfa285f5-7046-4ced-b183-32ea253a2741 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087681 Jun 16 17:36:55.177900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 175/343] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:36:55.205761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c03188bd-feaa-431b-a7a8-30b978cd4923 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:55.222871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c03188bd-feaa-431b-a7a8-30b978cd4923 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.223623 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c03188bd-feaa-431b-a7a8-30b978cd4923 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.278549 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c03188bd-feaa-431b-a7a8-30b978cd4923 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Going to try to start instance {{(pid=124160) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:36:55.343947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:55.367148 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c03188bd-feaa-431b-a7a8-30b978cd4923 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action" status: 202 len: 0 microversion: 2.1 time: 0.186421 Jun 16 17:36:55.367788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 169/344] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:36:55 2022] POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:36:55.379868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:55.380703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:55.394003 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.394462 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.395550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.395800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.402237 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:36:55.505787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:55.506553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:55.520744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.521220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.526722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.527312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.671568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:55.675304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:55.681124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cb5431da-1048-4f79-b257-de1df1594dfb tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1297 microversion: 2.1 time: 0.180582 Jun 16 17:36:55.690617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 170/345] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:55 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1297 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:55.694530 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8dc535e8-a568-4afe-939e-d02469a24f59 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1709 microversion: 2.1 time: 0.317661 Jun 16 17:36:55.695605 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 176/346] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:55 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1709 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:55.742261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:55.743870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:55.751587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.752917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:55.754827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:55.755422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:56.225789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:56.239761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-adeb95c6-2386-46ba-a5d0-cd8b636acb30 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.504050 Jun 16 17:36:56.240987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 171/347] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:55 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:56.699715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:56.702447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:56.712229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:56.713484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:56.723516 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:56.725048 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:56.725707 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:56.726685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:56.727869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:56.728818 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:56.729571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:56.732855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:56.913802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:56.923367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6f88d074-3d05-4ec1-b04f-3fbe664dd6ce tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1303 microversion: 2.1 time: 0.228033 Jun 16 17:36:56.923966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 177/348] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:56 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:57.257120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:57.257842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:57.264877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:57.266125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:57.267059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:57.267956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:57.304296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:57.331648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2824360f-0645-423b-9ab9-f9f3b8037cf5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1709 microversion: 2.1 time: 0.623705 Jun 16 17:36:57.332433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 172/349] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:56 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1709 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:57.640995 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:57.684073 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-27b37403-e60c-4a92-a5f4-1f9ad3adb6d8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1367 microversion: 2.1 time: 0.427736 Jun 16 17:36:57.687296 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 178/350] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:57 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:57.942998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:57.944255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:57.957782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:57.958374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:57.959431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:57.962366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:58.354613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:58.356143 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:58.366001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:58.374265 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:58.375596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:58.377088 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:58.889356 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:58.899393 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e6f70243-bb97-4871-9e19-ffd6a5ad919a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1709 microversion: 2.1 time: 0.552781 Jun 16 17:36:58.915474 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 179/351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:58 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1709 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:36:58.922869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:58.923589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:58.937306 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:58.942786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:58.943482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:58.945281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5c919767-ff04-4383-bff1-34a53ecd5938 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 1.007043 Jun 16 17:36:58.946038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:58.951145 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:58.954585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 173/352] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:57 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:59.342351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:36:59.358554 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5d2b91a9-e8da-49f2-9fac-1c85d36d4dc2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1557 microversion: 2.1 time: 0.450426 Jun 16 17:36:59.359207 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 180/353] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:58 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1557 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:36:59.380139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:59.380641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:59.397776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.398538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:59.399604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.400278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:59.462112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-236f735f-04ab-41f3-b362-5f686d740ffc req-90c19315-e087-4084-a215-c8f268ed28af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:36:59.480188 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-236f735f-04ab-41f3-b362-5f686d740ffc req-90c19315-e087-4084-a215-c8f268ed28af service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.482227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-236f735f-04ab-41f3-b362-5f686d740ffc req-90c19315-e087-4084-a215-c8f268ed28af service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:59.511398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-236f735f-04ab-41f3-b362-5f686d740ffc req-90c19315-e087-4084-a215-c8f268ed28af service nova] Creating event network-changed:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:36:59.530476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-236f735f-04ab-41f3-b362-5f686d740ffc req-90c19315-e087-4084-a215-c8f268ed28af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071674 Jun 16 17:36:59.531916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 181/354] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:36:59.607998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1e3faa57-7aef-4290-8a1b-b0b0c3380020 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231677 Jun 16 17:36:59.609893 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 174/355] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:36:59 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:36:59.925853 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:59.926432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:59.946108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.946802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:59.950115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.957959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:36:59.963362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:36:59.963945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:36:59.974371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:36:59.976462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:00.002222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:00.008066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:00.635142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:00.648399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-faada626-06cb-494d-922e-631698a4884b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1709 microversion: 2.1 time: 0.727985 Jun 16 17:37:00.653339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:00.657799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 182/356] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:59 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1709 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:00.669486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-391648bc-476a-4b03-b2b9-ea92a5de2754 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.709964 Jun 16 17:37:00.671851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 175/357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:36:59 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:01.669723 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:01.671303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:01.679497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:01.680298 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:01.681519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:01.682193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:01.692546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:01.699048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:01.712771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:01.713556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:01.714441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:01.716857 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:02.046011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:02.063570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-387bd7c4-d7dd-4100-9b25-6341f6b6512a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1713 microversion: 2.1 time: 0.394726 Jun 16 17:37:02.064272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 183/358] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:01 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1713 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:02.079991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-1f82c36e-2733-4138-b6f7-15f744ea3271 req-22bc8893-30de-4b3d-8d26-5a05d8e51174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb", "tag": "42876d97-ab72-447f-9723-b8c55e7cd05c"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:02.085033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:02.095465 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-db6d6acf-f2c9-44f6-9eae-124b02b4cf04 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.407428 Jun 16 17:37:02.105420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 176/359] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:01 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:02.117339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1f82c36e-2733-4138-b6f7-15f744ea3271 req-22bc8893-30de-4b3d-8d26-5a05d8e51174 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:02.118032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1f82c36e-2733-4138-b6f7-15f744ea3271 req-22bc8893-30de-4b3d-8d26-5a05d8e51174 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:02.152802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-1f82c36e-2733-4138-b6f7-15f744ea3271 req-22bc8893-30de-4b3d-8d26-5a05d8e51174 service nova] Creating event network-changed:42876d97-ab72-447f-9723-b8c55e7cd05c for instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb on hv-cinder-83754 Jun 16 17:37:02.160285 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-1f82c36e-2733-4138-b6f7-15f744ea3271 req-22bc8893-30de-4b3d-8d26-5a05d8e51174 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094744 Jun 16 17:37:02.162779 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 184/360] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:03.112644 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:03.113292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:03.128969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:03.129681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:03.130500 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:03.130924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:03.376030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:03.413831 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-32eff558-2814-4068-9641-7d1e7a4f08ba tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.303071 Jun 16 17:37:03.415792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 177/361] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:03 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:03.748729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-04c189a8-bb98-421d-b279-f86891c26171 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Action: 'create', calling method: .version_select at 0x7f84aa4b31f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-493824270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1uxF+iAndkdYhdI7mXIOXBlAfVCp3pVqQV2rG3NLUsvCL0hyesdIU4fPntT8+iIbIzKtvZpg+u2OAXNdwcDS1a597uTG7wzH3T2mkbWGFH+p8ECsB5Sn8Qk4Dobs3E7g=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:03.763595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-04c189a8-bb98-421d-b279-f86891c26171 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Getting quotas for project 35fdc8ef703e43f1a730a868721c4a2d. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:37:03.767830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-04c189a8-bb98-421d-b279-f86891c26171 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Getting quotas for user b41334c5088e4f4990637fd7e2964999 and project 35fdc8ef703e43f1a730a868721c4a2d. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:37:03.792784 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-04c189a8-bb98-421d-b279-f86891c26171 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.280735 Jun 16 17:37:03.794115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 185/362] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:37:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:04.432540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:04.436787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:04.444221 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:04.444674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:04.445503 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:04.445941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:04.484424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:04.599444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:04.609695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-67fe1e8f-0c42-4c42-8161-581203e8ee3f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.181613 Jun 16 17:37:04.610420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 178/363] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:04 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:05.625726 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:05.631250 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:05.632235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:05.640251 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:05.640911 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:05.641909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:05.642497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:05.780625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:05.781110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:05.795426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:05.797441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:05.800179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:05.800630 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:05.860950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d3312975-439d-4c26-b8d8-45cea10f1d3c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/ips" status: 200 len: 152 microversion: 2.20 time: 0.086821 Jun 16 17:37:05.862952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 179/364] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jun 16 17:37:05 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/ips => generated 152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:37:05.945650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:05.956927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-becb0401-f0da-47cf-9918-6e01428038fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.331915 Jun 16 17:37:05.962518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 186/365] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:05 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:06.979882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:06.980642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:06.987067 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:06.987582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:06.988428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:06.988925 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:07.139472 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:07.147848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-31d068f2-f3ac-4d68-bc64-fe2e47cae68b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.171864 Jun 16 17:37:07.148540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 180/366] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:06 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:08.166991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:08.167655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:08.174642 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:08.175095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:08.175865 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:08.176298 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:08.337499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:08.345046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-53b3b67a-43f4-498c-9e8e-7be66d967a75 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.182940 Jun 16 17:37:08.345650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 187/367] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:08 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:09.361744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:09.362349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:09.369128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:09.369607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:09.370368 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:09.370802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:09.505808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:09.514416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ac209ffc-2a4f-401f-b083-09f64afcd238 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.156543 Jun 16 17:37:09.514991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 181/368] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:09 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:10.532730 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:10.533356 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:10.540171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:10.540608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:10.541396 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:10.541825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:10.686043 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:10.695054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-09355b2f-1770-4b41-850e-eb3ea8c387c0 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.167750 Jun 16 17:37:10.696028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 188/369] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:10 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:11.712529 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:11.713177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:11.719749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:11.720197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:11.720965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:11.721426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:11.858041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:11.866008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-acfbfd10-f180-4d81-ab41-4134083504c1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.157391 Jun 16 17:37:11.866605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 182/370] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:11 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:12.348864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:12.349506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:12.355905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.356346 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:12.357108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.357556 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:12.381520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lazy-loading 'flavor' on Instance uuid ade4cabc-bd7b-4506-b836-9178181c78e2 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:37:12.661701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0533de76-59b0-4ce6-bdb9-9dcc90075a01 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/action" status: 202 len: 0 microversion: 2.20 time: 0.316736 Jun 16 17:37:12.662717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 189/371] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 17:37:12 2022] POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:37:12.672140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.673039 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:12.679992 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.680460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:12.681292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.681699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:12.823287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:12.832151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:12.833724 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:12.834879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0fe035c7-9b9d-4cad-b2b4-3defebcfed61 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.167871 Jun 16 17:37:12.835432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 183/372] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:12.884990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:12.885690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:12.891939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.892400 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:12.893137 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:12.893591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:13.038519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:13.046852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-42f149b7-9691-4b96-aae3-d0e8ba191807 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.166167 Jun 16 17:37:13.047620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 190/373] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:12 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:13.852617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:13.853259 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:13.860876 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:13.861358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:13.862200 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:13.862638 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:14.012633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:14.024753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:14.026573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:14.029606 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-65714449-880c-4a3a-9d4a-c6915e7db9a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.180532 Jun 16 17:37:14.029984 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 184/374] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:13 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:14.063901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:14.064511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:14.066975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=26 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:14.072588 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:14.073037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:14.076750 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:14.076750 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:14.218067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:14.226288 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0061cd2c-07db-4da2-8e46-2681d5ede8c6 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.166214 Jun 16 17:37:14.227055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 191/375] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:14 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:14.517122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-ce000b32-b7b7-47e3-8f33-9c87f992e1aa req-c9d023bd-a89f-4ed8-ab5f-1859f6e58743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "name": "network-vif-plugged", "status": "completed", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:14.526025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ce000b32-b7b7-47e3-8f33-9c87f992e1aa req-c9d023bd-a89f-4ed8-ab5f-1859f6e58743 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:14.526462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ce000b32-b7b7-47e3-8f33-9c87f992e1aa req-c9d023bd-a89f-4ed8-ab5f-1859f6e58743 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:14.537770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-ce000b32-b7b7-47e3-8f33-9c87f992e1aa req-c9d023bd-a89f-4ed8-ab5f-1859f6e58743 service nova] Creating event network-vif-plugged:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:37:14.547906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-ce000b32-b7b7-47e3-8f33-9c87f992e1aa req-c9d023bd-a89f-4ed8-ab5f-1859f6e58743 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044273 Jun 16 17:37:14.548766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 185/376] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:15.054413 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:15.055256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:15.062040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.062508 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.063280 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.063816 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.210518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:15.221453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:15.223063 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:15.224120 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b3b8874b-0b1c-4f2a-9daf-56ab1778e316 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.174148 Jun 16 17:37:15.234223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 192/377] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:15 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:15.245277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:15.246762 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:15.261355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.262542 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.263426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.263960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.422736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:15.430280 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-07317aeb-9fc8-467f-9a43-aa9906f89a98 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.190132 Jun 16 17:37:15.430850 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 186/378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:15 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:15.480774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-116581298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489756062", "security_groups": [{"name": "tempest-secgroup-smoke-266615842"}], "block_device_mapping_v2": [{"uuid": "bf2354da-94ce-4334-a28c-53996789c8df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6e803cc9-885b-4092-b21c-ed0c8b49c26c"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:15.599787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] validate_networks() for [('6e803cc9-885b-4092-b21c-ed0c8b49c26c', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:37:15.977976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:37:15.978546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:37:15.979026 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:37:15.979584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:37:15.980585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:37:15.990432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.991050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.991845 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:15.992527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:15.999455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:16.011565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:37:16.016579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for user faf0a0102da24cedaedd0c67273e275b and project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:37:16.076302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:37:16.078483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf2354da-94ce-4334-a28c-53996789c8df',volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:37:16.176053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:16.215228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-17271dee-2d39-4fb6-91b2-79807e636e72 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738508 Jun 16 17:37:16.216032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 193/379] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:37:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:37:16.226366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c0e15155-e901-44ee-859c-9bb3d1fbfe29 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:16.227003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c0e15155-e901-44ee-859c-9bb3d1fbfe29 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:16.248590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:16.249287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:16.256383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:16.256833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:16.257644 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:16.258082 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:16.282981 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c0e15155-e901-44ee-859c-9bb3d1fbfe29 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:16.290015 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c0e15155-e901-44ee-859c-9bb3d1fbfe29 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1093 microversion: 2.1 time: 0.067397 Jun 16 17:37:16.290703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 187/380] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:16 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:16.414756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:16.424424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:16.426041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:16.427790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8d9a449c-bcd5-490b-80be-a193cf7c9cb1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.184075 Jun 16 17:37:16.428348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 194/381] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:16 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:16.449331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:16.449985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:16.456982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:16.457555 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:16.458388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:16.459048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:16.613061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:16.618051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:16.624157 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d222efeb-d50f-4872-8e93-c555a9fa85fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1370 microversion: 2.1 time: 0.179465 Jun 16 17:37:16.624826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 188/382] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:16 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:17.308441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:17.309083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:17.315601 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.316052 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.316851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.317324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.379467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:17.388369 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-531541d0-283c-4081-8f24-88b07ebe8731 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1191 microversion: 2.1 time: 0.083647 Jun 16 17:37:17.389594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 195/383] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:17 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:17.448001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:17.448612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:17.456578 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.457035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.457972 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.458703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.644065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:17.645014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:17.652626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.653081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.653930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.655116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.710394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:17.719935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:17.722614 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:17.725220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4b265d46-3420-4e92-bc97-8bb6d6530b1d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.280378 Jun 16 17:37:17.738642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 189/384] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:17 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:17.880799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:17.889695 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-79ce0f1a-e012-476d-b274-5fa76a20ab09 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1564 microversion: 2.1 time: 0.251094 Jun 16 17:37:17.890587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 196/385] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:17 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:17.907895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:17.908724 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:17.915479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.915934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:17.916698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:17.917124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:18.255944 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-21d334e6-86a9-4dde-a38e-b6cd837bca21 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.352371 Jun 16 17:37:18.256638 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 190/386] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:37:17 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-interface => generated 285 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:18.407739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:18.409134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:18.416675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:18.418501 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:18.419586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:18.420808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:18.650305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:18.667093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3bbccdfe-bd95-4138-83c7-c96c03697770 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1276 microversion: 2.1 time: 0.265034 Jun 16 17:37:18.677689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 197/387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:18 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:18.744678 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:18.745557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:18.763895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:18.765341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:18.769014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:18.770252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:18.942098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:18.950113 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:18.951610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:18.952771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c8b837ac-6d83-4638-b3a6-80a21f29b660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.212910 Jun 16 17:37:18.953371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 191/388] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:18 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:19.695582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:19.696817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:19.704103 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:19.705606 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:19.706591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:19.707212 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:19.894429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:19.904013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8e88f2e2-1412-44ea-b307-f8cb9f5bb242 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.216538 Jun 16 17:37:19.918308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 198/389] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:19 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:19.972621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:19.973260 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:19.979521 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:19.980600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:19.993558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:19.994120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:20.216434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:20.225230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:20.227237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:20.228545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-53897548-4bee-41f1-b140-01b744b530a7 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.260001 Jun 16 17:37:20.229098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 192/390] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:19 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:20.404608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-770f3053-d0af-4874-97e7-59d500cde312 req-89d87f41-a5d2-4aab-bbff-2772bb0a9666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d39f223-c8ed-4c3c-a006-fe3698711485", "tag": "161d75cc-2de3-4882-81a1-afdc5ee23ee9"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:20.439365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-770f3053-d0af-4874-97e7-59d500cde312 req-89d87f41-a5d2-4aab-bbff-2772bb0a9666 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:20.439959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-770f3053-d0af-4874-97e7-59d500cde312 req-89d87f41-a5d2-4aab-bbff-2772bb0a9666 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:20.455015 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-770f3053-d0af-4874-97e7-59d500cde312 req-89d87f41-a5d2-4aab-bbff-2772bb0a9666 service nova] Creating event network-changed:161d75cc-2de3-4882-81a1-afdc5ee23ee9 for instance 8d39f223-c8ed-4c3c-a006-fe3698711485 on hv-cinder-83754 Jun 16 17:37:20.473464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-770f3053-d0af-4874-97e7-59d500cde312 req-89d87f41-a5d2-4aab-bbff-2772bb0a9666 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077346 Jun 16 17:37:20.474673 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 199/391] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:20.927310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:20.927917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:20.935345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:20.936132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:20.937271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:20.937776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:21.137347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:21.149670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a4ef609e-0d1c-44aa-95b4-9ba8300ec823 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.223550 Jun 16 17:37:21.149670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 193/392] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:20 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:21.249686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:21.250657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:21.257787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:21.258249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:21.259028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:21.259468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:21.415799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:21.428584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:21.430523 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:21.432216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6ea0696e-703f-44c3-a9f9-fbe31c1b0d05 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.187871 Jun 16 17:37:21.433475 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 200/393] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:21 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:22.164561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:22.165453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:22.173212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:22.173841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:22.174648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:22.175247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:22.333143 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:22.342339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-09366f92-05f2-4793-a0f4-bd88bd558a5b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.182189 Jun 16 17:37:22.342926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 194/394] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:22 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:22.452555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:22.453178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:22.460001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:22.460565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:22.461434 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:22.461939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:22.506344 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-2f0e37b2-4530-4682-ba39-53dd52f4cc9e req-1e1e977a-c4e1-45ef-a83b-55bd8d90bb38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:22.526161 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2f0e37b2-4530-4682-ba39-53dd52f4cc9e req-1e1e977a-c4e1-45ef-a83b-55bd8d90bb38 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:22.527168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2f0e37b2-4530-4682-ba39-53dd52f4cc9e req-1e1e977a-c4e1-45ef-a83b-55bd8d90bb38 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:22.553568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-2f0e37b2-4530-4682-ba39-53dd52f4cc9e req-1e1e977a-c4e1-45ef-a83b-55bd8d90bb38 service nova] Creating event network-changed:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:37:22.568223 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-2f0e37b2-4530-4682-ba39-53dd52f4cc9e req-1e1e977a-c4e1-45ef-a83b-55bd8d90bb38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064469 Jun 16 17:37:22.569312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 195/395] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:22.630309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:22.639143 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:22.640686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:22.641864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-576715fa-6cea-4172-a41a-ae192bf58967 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.194269 Jun 16 17:37:22.642419 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 201/396] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:22 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:23.360261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:23.360887 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:23.362851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=66 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:23.368774 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:23.369246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:23.370206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:23.371164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:23.516621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:23.527263 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ae86dee6-eaef-49be-9e5d-91b89b16e70b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.172580 Jun 16 17:37:23.528051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 196/397] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:23 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:23.660558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:23.661174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:23.667787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:23.668318 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:23.669008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:23.669493 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:23.830154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:23.839809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:23.841552 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:23.842709 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-25a2620b-cdfb-4014-a881-f05c3608f63d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.185930 Jun 16 17:37:23.843342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 202/398] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:23 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:24.545008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:24.545673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:24.552095 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:24.552533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:24.553325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:24.553756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:24.685852 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:24.693210 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e7fdb9ce-9dae-4ce7-8c2e-080e3ee98d85 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.152781 Jun 16 17:37:24.693768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 197/399] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:24 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:24.861670 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:24.862282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:24.869024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:24.869509 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:24.870908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:24.871786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:25.001736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:25.009515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:25.011051 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:25.012209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fe7f4c3a-4e38-4f97-ae1d-9a5f5a5cfa58 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.154458 Jun 16 17:37:25.012760 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 203/400] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:24 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:25.710002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:25.710592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:25.717194 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:25.717629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:25.718383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:25.718809 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:25.857243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:25.864916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e14d0c5c-1f44-472e-8faf-98ae8a065a53 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.158729 Jun 16 17:37:25.865514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 198/401] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:25 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:26.030836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:26.031443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:26.033933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:26.034584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=6 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:26.040877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:26.041363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:26.042729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:26.043157 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:26.186115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:26.193938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:26.195426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:26.196567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2ba994b2-6ac9-41ad-be21-baf1b09e330c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.169739 Jun 16 17:37:26.197117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 204/402] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:26 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:26.883741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:26.884354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:26.887164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:26.894825 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:26.895267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:26.896036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:26.896468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:27.031721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:27.039063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d5042d0d-9520-4623-bc66-dc0d37aaf28a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.160461 Jun 16 17:37:27.039626 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 199/403] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:26 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:27.215707 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:27.216243 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:27.222750 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:27.223195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:27.223954 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:27.224385 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:27.356470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:27.364525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:27.366066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:27.367485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-67264dfa-8f35-4611-8851-8a5725260325 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.155634 Jun 16 17:37:27.368041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 205/404] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:27 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:28.055546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:28.056182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:28.063310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:28.063770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:28.064865 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:28.065446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:28.200396 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:28.208159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-de61bebc-4ba0-41da-8fe0-25375e676d8b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.156329 Jun 16 17:37:28.208728 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 200/405] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:28 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:28.389032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:28.389704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:28.396294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:28.396643 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:28.397434 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:28.397864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:28.532667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:28.540570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:28.542587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:28.543815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a8ec0c89-69a2-49a4-ac63-d86f815320ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.159450 Jun 16 17:37:28.544367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 206/406] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:28 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:29.225399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:29.226009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:29.233040 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:29.233563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:29.234345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:29.234781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:29.365679 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:29.373467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-00301ab5-87d8-4df7-b21b-8a22de183079 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.151882 Jun 16 17:37:29.374025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 201/407] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:29 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:29.562532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:29.563142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:29.569334 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:29.569780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:29.570538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:29.570973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:29.655912 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2034174205", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-493824270", "security_groups": [{"name": "tempest-secgroup-smoke-1549279299"}], "networks": [{"uuid": "faa616db-04da-45e0-8b5a-5b794f8b5dd6"}], "block_device_mapping_v2": [{"uuid": "b4555b33-d80f-4893-8a79-9bbd844dbdc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:29.705670 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:29.713812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:29.715682 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:29.716829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6e3b8b02-2c1b-47cf-b337-e780a3141590 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.158328 Jun 16 17:37:29.717729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 207/408] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:29 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:29.770206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] validate_networks() for [('faa616db-04da-45e0-8b5a-5b794f8b5dd6', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:37:30.139716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:37:30.140121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:37:30.140592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:37:30.140997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:37:30.141454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:37:30.151975 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.152546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.153389 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.153824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.170619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Getting quotas for project 35fdc8ef703e43f1a730a868721c4a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:37:30.174495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Getting quotas for user b41334c5088e4f4990637fd7e2964999 and project 35fdc8ef703e43f1a730a868721c4a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:37:30.235535 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:37:30.238916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4555b33-d80f-4893-8a79-9bbd844dbdc2',volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:37:30.374250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-eb1bb3e5-3a80-4164-ac59-4740a2321b9a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722204 Jun 16 17:37:30.375104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 202/409] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:37:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:37:30.390774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-99d86a57-ff5c-4b8e-b271-b8ea974c7f63 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:30.393972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-99d86a57-ff5c-4b8e-b271-b8ea974c7f63 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:30.397230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:30.397891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:30.409794 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.409794 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.409794 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.410152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.508989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-99d86a57-ff5c-4b8e-b271-b8ea974c7f63 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:30.517297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-99d86a57-ff5c-4b8e-b271-b8ea974c7f63 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1088 microversion: 2.1 time: 0.136036 Jun 16 17:37:30.528297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 208/410] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:30 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1088 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:30.600490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:30.608696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9ae7df7d-6b21-4eb4-bf25-bad2c357204d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.221776 Jun 16 17:37:30.610550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 203/411] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:30 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:30.735910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:30.736513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:30.747564 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.748144 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.748953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:30.749409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:30.937976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:30.947195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:30.949257 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:30.950436 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-be2c711d-1e5d-4027-8f6a-c28763efa719 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.218412 Jun 16 17:37:30.951153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 209/412] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:30 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:31.534729 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:31.535451 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:31.542604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.543049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:31.543816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.544246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:31.614453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:31.623967 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5f34ae78-b4e9-4dac-b318-3acfc867c05e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1186 microversion: 2.1 time: 0.093026 Jun 16 17:37:31.624710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 204/413] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:31 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:31.627390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:31.628005 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:31.635894 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.636813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:31.637744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.638206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:31.785880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:31.794300 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eb8fa65a-8e05-406a-992f-39e9481c3532 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.170981 Jun 16 17:37:31.794883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 210/414] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:31 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:31.970247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:31.970853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:31.976878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.977369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:31.978127 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:31.978559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:32.110505 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:32.119108 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:32.120641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:32.122588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2ad2a88e-b150-4c4f-8af6-ac62bcc1eaa4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.156318 Jun 16 17:37:32.132157 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 205/415] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:31 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:32.594364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-9c11bf7c-d162-4639-a332-d7d39b166ccf req-9798f1de-c550-40fd-9a8c-e9fa0781f977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d39f223-c8ed-4c3c-a006-fe3698711485", "name": "network-vif-plugged", "status": "completed", "tag": "161d75cc-2de3-4882-81a1-afdc5ee23ee9"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:32.602405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9c11bf7c-d162-4639-a332-d7d39b166ccf req-9798f1de-c550-40fd-9a8c-e9fa0781f977 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:32.602847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9c11bf7c-d162-4639-a332-d7d39b166ccf req-9798f1de-c550-40fd-9a8c-e9fa0781f977 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:32.626482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-9c11bf7c-d162-4639-a332-d7d39b166ccf req-9798f1de-c550-40fd-9a8c-e9fa0781f977 service nova] Creating event network-vif-plugged:161d75cc-2de3-4882-81a1-afdc5ee23ee9 for instance 8d39f223-c8ed-4c3c-a006-fe3698711485 on hv-cinder-83754 Jun 16 17:37:32.636768 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-9c11bf7c-d162-4639-a332-d7d39b166ccf req-9798f1de-c550-40fd-9a8c-e9fa0781f977 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044402 Jun 16 17:37:32.638525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 211/416] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:32.643144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:32.644619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:32.654382 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:32.654959 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:32.655853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:32.656650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:32.803504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:32.812625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:32.813655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:32.814021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3e2dac26-d2ae-4912-8577-8d4095670690 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.175099 Jun 16 17:37:32.814636 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 206/417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:32 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:32.824701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:32.827833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:32.828909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:32.829467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.033718 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:33.038596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:33.045797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-57288f99-8760-4798-883e-205410c23b5e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.238365 Jun 16 17:37:33.055564 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 212/418] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:32 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:33.126703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-cade4946-e82d-442a-874e-81cfc8edbf68 req-0f8f6016-36b1-4291-86f9-b72a4a014148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:33.139987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-cade4946-e82d-442a-874e-81cfc8edbf68 req-0f8f6016-36b1-4291-86f9-b72a4a014148 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:33.140941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-cade4946-e82d-442a-874e-81cfc8edbf68 req-0f8f6016-36b1-4291-86f9-b72a4a014148 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.143306 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:33.144104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:33.148105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:33.157011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:33.157997 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.160716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-cade4946-e82d-442a-874e-81cfc8edbf68 req-0f8f6016-36b1-4291-86f9-b72a4a014148 service nova] Creating event network-changed:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:37:33.162422 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:33.163258 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.168918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-cade4946-e82d-442a-874e-81cfc8edbf68 req-0f8f6016-36b1-4291-86f9-b72a4a014148 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047251 Jun 16 17:37:33.169936 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 207/419] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:33.308325 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:33.316888 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:33.318499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:33.319675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0f72e3cd-bf8b-4df8-bd3f-92c6112dfe1e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.180987 Jun 16 17:37:33.320236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 213/420] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:33 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:37:33.832982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:33.833721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:33.840472 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:33.840914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.841710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:33.842146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:33.981399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:33.988995 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1134c9b2-4643-4ffc-a8ae-d432252cceec tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.160711 Jun 16 17:37:33.989698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 208/421] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:33 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:34.062837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:34.063448 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:34.070077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:34.070521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:34.071302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:34.071742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:34.207547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:34.215985 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9cb41ec8-5d93-43a5-9b65-da254d29600f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1264 microversion: 2.1 time: 0.156879 Jun 16 17:37:34.216561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 214/422] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:34 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:34.339312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:34.339834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:34.345811 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:34.346258 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:34.347025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:34.347457 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:34.480080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:34.489933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:34.491980 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:34.493196 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-36bf191b-1c18-4866-b1ae-9f1512d55464 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.158507 Jun 16 17:37:34.494295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 209/423] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:34 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:35.006010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:35.006611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:35.013681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.014134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.014908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.015348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.155129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.163226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-49b6f072-c340-429b-ba1b-7cb5101c6546 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.161063 Jun 16 17:37:35.163791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 215/424] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:35 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:35.232334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:35.233051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:35.240020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.240476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.241281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.241985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.385875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.393796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9edbcd3d-76d7-4760-a195-027026bd0e15 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1451 microversion: 2.1 time: 0.165460 Jun 16 17:37:35.394391 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 210/425] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:35 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:35.411040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:35.411764 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:35.418754 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.419281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.420127 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.420634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.512353 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:35.513114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:35.519217 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.519667 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.520441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:35.520878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:35.565447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.573974 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4ba629ab-d3ec-4de3-b916-91d5e9df9cb1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1451 microversion: 2.1 time: 0.166576 Jun 16 17:37:35.574697 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 216/426] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:35 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:35.668573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.676431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.678105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:35.679201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5d8acdba-0d26-45b8-afe3-4807ce5936f1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1745 microversion: 2.20 time: 0.171363 Jun 16 17:37:35.679752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 211/427] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:35 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:37:36.179852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:36.180463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:36.187615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:36.188067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:36.188873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:36.189340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:36.329443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:36.336912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d41443c7-7ca6-47ee-b8f6-8e8eb8ec592d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.160945 Jun 16 17:37:36.337516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 217/428] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:36 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:36.701054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:36.701753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:36.709716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:36.710317 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:36.711785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:36.712352 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:36.864532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:36.874373 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:36.876201 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:36.877630 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b8745931-ce8e-40d9-9b87-3dddc85f429c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1745 microversion: 2.20 time: 0.182828 Jun 16 17:37:36.878572 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 212/429] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:36 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:37.358478 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:37.359874 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:37.373417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-9ffb0f83-e340-45eb-89eb-81664bdb7232 req-b4a5ab0e-7e3a-4700-b0db-e247e216f84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d39f223-c8ed-4c3c-a006-fe3698711485", "tag": "161d75cc-2de3-4882-81a1-afdc5ee23ee9"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:37.376833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:37.377320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:37.378089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:37.378523 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:37.381817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9ffb0f83-e340-45eb-89eb-81664bdb7232 req-b4a5ab0e-7e3a-4700-b0db-e247e216f84b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:37.382255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9ffb0f83-e340-45eb-89eb-81664bdb7232 req-b4a5ab0e-7e3a-4700-b0db-e247e216f84b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:37.394028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-9ffb0f83-e340-45eb-89eb-81664bdb7232 req-b4a5ab0e-7e3a-4700-b0db-e247e216f84b service nova] Creating event network-changed:161d75cc-2de3-4882-81a1-afdc5ee23ee9 for instance 8d39f223-c8ed-4c3c-a006-fe3698711485 on hv-cinder-83754 Jun 16 17:37:37.398916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-9ffb0f83-e340-45eb-89eb-81664bdb7232 req-b4a5ab0e-7e3a-4700-b0db-e247e216f84b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029512 Jun 16 17:37:37.399912 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 213/430] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:37.524191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:37.534713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-83b77160-03e9-41d4-a9a6-e11f273ec52e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.182458 Jun 16 17:37:37.535313 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 218/431] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:37 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:37.896271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:37.896966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:37.904697 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:37.905493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:37.906274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:37.906709 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:38.046185 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:38.054270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:38.055786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:38.057011 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-62766ccd-47f9-4512-a463-81617887e8fa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1745 microversion: 2.20 time: 0.164938 Jun 16 17:37:38.057792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 214/432] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:37 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:38.552002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:38.552626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:38.559448 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:38.559883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:38.560645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:38.561078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:38.587311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-6475bd34-23be-4adc-8e99-9c7cbafd71ef req-e42602ec-d0f4-4ebd-b4bc-3bdf69e12ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "name": "network-vif-plugged", "status": "completed", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:38.599430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-6475bd34-23be-4adc-8e99-9c7cbafd71ef req-e42602ec-d0f4-4ebd-b4bc-3bdf69e12ae0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:38.599878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-6475bd34-23be-4adc-8e99-9c7cbafd71ef req-e42602ec-d0f4-4ebd-b4bc-3bdf69e12ae0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:38.620207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-6475bd34-23be-4adc-8e99-9c7cbafd71ef req-e42602ec-d0f4-4ebd-b4bc-3bdf69e12ae0 service nova] Creating event network-vif-plugged:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:37:38.626469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-6475bd34-23be-4adc-8e99-9c7cbafd71ef req-e42602ec-d0f4-4ebd-b4bc-3bdf69e12ae0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043379 Jun 16 17:37:38.627421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 215/433] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:38.698494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:38.706312 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-08b3e0d8-fe76-4b0b-8007-953f61d51ef7 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.158025 Jun 16 17:37:38.706906 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 219/434] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:38 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:39.076819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:39.077557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:39.083727 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:39.084168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:39.084920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:39.085371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:39.238934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:39.250425 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:39.252366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:39.253787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7d228db5-454a-45d2-93bd-61a2d7b7fc8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.181429 Jun 16 17:37:39.257207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 216/435] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:39 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:39.726956 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:39.727676 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:39.735561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:39.736132 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:39.736936 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:39.737385 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:39.909805 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:39.923507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2b97818b-908f-4dd7-97e3-6e6a578a5d06 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.202929 Jun 16 17:37:39.935219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 220/436] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:39 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:40.282183 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:40.283661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:40.286600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:40.287355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=6 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:40.294772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:40.295556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:40.296429 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:40.296979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:40.464839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:40.473708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:40.475292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:40.476435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-15dc1937-8cf3-4931-b5ff-e269f8b67a80 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.202080 Jun 16 17:37:40.476977 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 217/437] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:40 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:40.943155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:40.943995 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:40.947281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:40.953823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:40.954391 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:40.955269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:40.955926 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:41.110698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:41.121421 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3a298108-053f-4111-af05-82f6913b1394 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.182243 Jun 16 17:37:41.131772 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 221/438] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:40 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:41.498553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:41.499087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:41.505523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:41.506840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:41.507842 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:41.508467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:41.673518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:41.682746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:41.684439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:41.685701 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3203b1c8-1e59-4712-81e4-186d172d2edc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.193112 Jun 16 17:37:41.686691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 218/439] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:41 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:37:42.139776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:42.141039 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:42.151944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:42.152685 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:42.153574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:42.154070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:42.358221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:42.366795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ec208ae6-d44b-4418-b0b3-4db883de280e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.231686 Jun 16 17:37:42.368460 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 222/440] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:42 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:42.710100 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:42.711558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:42.722162 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:42.723622 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:42.724648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:42.725274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:42.889742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:42.898958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:42.900487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:42.901708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-00bd1223-6f91-4ef7-98e7-89107e11e38a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.197042 Jun 16 17:37:42.905188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 219/441] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:42 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:43.390449 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:43.391872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:43.400112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:43.402076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:43.403154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:43.403962 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:43.584577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:43.593340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3c93f5e2-4cc6-4040-8701-df4792badd26 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.209287 Jun 16 17:37:43.594042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 223/442] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:43 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:43.922635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:43.923346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:43.931441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:43.934496 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:43.935705 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:43.936150 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:44.093528 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:44.105252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:44.107327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:44.108495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7e450673-d436-4264-9322-9dbcaeb377db tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.189688 Jun 16 17:37:44.109049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 220/443] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:43 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:44.610779 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:44.611573 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:44.618580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:44.619046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:44.620539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:44.620968 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:44.637956 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-957ab5b8-c0fa-4ec1-8006-ef39dbe6a754 req-a51b4ae0-2d0a-498c-8dad-5a2cb018156a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "name": "network-vif-plugged", "status": "completed", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:44.655178 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-957ab5b8-c0fa-4ec1-8006-ef39dbe6a754 req-a51b4ae0-2d0a-498c-8dad-5a2cb018156a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:44.655629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-957ab5b8-c0fa-4ec1-8006-ef39dbe6a754 req-a51b4ae0-2d0a-498c-8dad-5a2cb018156a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:44.673106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-957ab5b8-c0fa-4ec1-8006-ef39dbe6a754 req-a51b4ae0-2d0a-498c-8dad-5a2cb018156a service nova] Creating event network-vif-plugged:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:37:44.682135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-957ab5b8-c0fa-4ec1-8006-ef39dbe6a754 req-a51b4ae0-2d0a-498c-8dad-5a2cb018156a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047478 Jun 16 17:37:44.683482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 221/444] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:44.815771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:44.824333 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-87b25e9d-4dd9-4480-8fab-f5991213f9ce tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.217422 Jun 16 17:37:44.825230 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 224/445] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:44 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:45.128601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:45.128601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:45.136843 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:45.137277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:45.138120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:45.138554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:45.295231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:45.303855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:45.305677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:45.307969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d665aa4b-3411-46a7-9ee9-583f07978af8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.183922 Jun 16 17:37:45.307969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 222/446] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:45 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:45.841008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:45.842429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:45.849266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:45.849842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:45.850527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:45.851066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:46.018537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:46.030531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-28f21336-c2c1-4e19-bcfd-0e9cb1960b76 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.193462 Jun 16 17:37:46.031325 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 225/447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:45 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:46.327102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:46.327707 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:46.336236 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:46.336766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:46.337581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:46.338218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:46.502590 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:46.512675 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:46.514212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:46.515386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1c6648df-2bae-4f73-8380-fd0650abd568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.193819 Jun 16 17:37:46.515946 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 223/448] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:46 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:47.050185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:47.051083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:47.054050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=67 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:47.061914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:47.061914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:47.061914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:47.062311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:47.226228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:47.247396 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-089b3034-665d-4b4d-98be-b34821372655 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1260 microversion: 2.1 time: 0.202202 Jun 16 17:37:47.248189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 226/449] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:47 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:47.534720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:47.535748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:47.542629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:47.543170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:47.544001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:47.544495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:47.692536 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:47.702678 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:47.704273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:47.705447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-37517c7f-2582-4615-a91a-d28761a6b883 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1740 microversion: 2.20 time: 0.174622 Jun 16 17:37:47.706029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 224/450] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:47 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:48.264881 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:48.265532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:48.272185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.272635 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.273435 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.274032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.409460 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:48.418916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eb84df0f-ca02-4cdf-9836-08baa8630c3c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1444 microversion: 2.1 time: 0.157855 Jun 16 17:37:48.419502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 227/451] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:48 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:48.434668 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:48.435287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:48.441170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.441621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.442366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.442788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.575564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:48.583371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f0077095-988e-4b6f-be25-bfdf113f2386 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1444 microversion: 2.1 time: 0.152459 Jun 16 17:37:48.583947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 225/452] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:48 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:37:48.723778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:48.724477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:48.737786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.738354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.739212 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:48.739710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:48.885906 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:48.894033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:48.895556 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:48.896714 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d9bb8cfe-2121-4ec5-8d99-83724eef00a8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1722 microversion: 2.20 time: 0.176857 Jun 16 17:37:48.897289 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 228/453] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:48 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:49.917230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:49.917961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:49.924400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:49.924921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:49.925730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:49.926171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:49.945125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:50.061821 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:50.069727 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:50.071279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:50.073767 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2e236e2d-35ac-4d66-8f62-03f0ac015d3f tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1722 microversion: 2.20 time: 0.160629 Jun 16 17:37:50.074346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 226/454] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:49 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:50.621611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-17eec2bf-aa12-4fcb-8e41-9e7ca2c742f4 req-1dde95c8-caab-4bea-a5d0-817a693b4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "name": "network-vif-unplugged", "status": "completed", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:50.630435 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-17eec2bf-aa12-4fcb-8e41-9e7ca2c742f4 req-1dde95c8-caab-4bea-a5d0-817a693b4fc7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:50.630882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-17eec2bf-aa12-4fcb-8e41-9e7ca2c742f4 req-1dde95c8-caab-4bea-a5d0-817a693b4fc7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:50.642920 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-17eec2bf-aa12-4fcb-8e41-9e7ca2c742f4 req-1dde95c8-caab-4bea-a5d0-817a693b4fc7 service nova] Creating event network-vif-unplugged:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:37:50.647900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-17eec2bf-aa12-4fcb-8e41-9e7ca2c742f4 req-1dde95c8-caab-4bea-a5d0-817a693b4fc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030954 Jun 16 17:37:50.648798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 229/455] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:50.777308 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-8e76fc75-3940-4743-a30b-a04ee889e819 req-d18c1a88-107c-482a-9fd7-71ac0300a1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:50.785681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8e76fc75-3940-4743-a30b-a04ee889e819 req-d18c1a88-107c-482a-9fd7-71ac0300a1c7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:50.786125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8e76fc75-3940-4743-a30b-a04ee889e819 req-d18c1a88-107c-482a-9fd7-71ac0300a1c7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:50.798173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-8e76fc75-3940-4743-a30b-a04ee889e819 req-d18c1a88-107c-482a-9fd7-71ac0300a1c7 service nova] Creating event network-changed:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:37:50.803118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-8e76fc75-3940-4743-a30b-a04ee889e819 req-d18c1a88-107c-482a-9fd7-71ac0300a1c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030381 Jun 16 17:37:50.803714 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 227/456] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:37:51.092850 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:51.093831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:51.100453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:51.101001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:51.101817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:51.102261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:51.107951 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:51.265620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:51.276113 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:51.280190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:51.281505 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b66b9477-1228-4b7e-a156-3b3b8fb0a181 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1722 microversion: 2.20 time: 0.193298 Jun 16 17:37:51.282223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 230/457] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:51 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:52.300990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:52.301708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:52.308621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.309080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.309887 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.310329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.436463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:52.444483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:52.446047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:52.448279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cfe6d284-b280-4b11-96f5-55b817338341 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1665 microversion: 2.20 time: 0.151058 Jun 16 17:37:52.448838 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 228/458] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:52 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:52.466724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e584a876-361d-4092-8e33-99369bc9d766"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:52.467834 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:52.474405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.474857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.475623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.476064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.748836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-52b619b5-2cc0-478d-bc78-0bf08661a03c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286880 Jun 16 17:37:52.749471 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 231/459] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jun 16 17:37:52 2022] POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:37:52.864078 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:52.864634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:52.871676 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.872109 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.872858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.873312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.964225 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9df67ad4-b138-4990-bcf9-c93485c11f8d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/action" status: 202 len: 0 microversion: 2.20 time: 0.103928 Jun 16 17:37:52.965070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 229/460] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 17:37:52 2022] POST /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:37:52.972961 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:52.973592 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:52.980140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.980580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:52.981367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:52.981799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:53.115227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:53.129684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:53.132660 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:53.133968 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-26a9d906-da76-4c6b-a523-a1689d457fe0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1751 microversion: 2.20 time: 0.164915 Jun 16 17:37:53.135107 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 232/461] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:52 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:54.154997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:54.155623 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:54.157581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:37:54.163291 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:54.163736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:54.164499 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:54.164936 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:54.301875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:54.310643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:54.312144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:54.313325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5a694d5c-40a1-4a27-b5b0-5dd222d0f0f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1753 microversion: 2.20 time: 0.163428 Jun 16 17:37:54.313876 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 230/462] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:54 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:55.331771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:55.332375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:55.339468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:55.339943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:55.340705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:55.341138 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:55.471577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:55.480631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:55.482299 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:55.483473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4df2d44f-bd17-4bb7-80a9-6be08fef8b28 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.155647 Jun 16 17:37:55.484038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 233/463] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:55 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:56.502388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:56.502916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:56.509592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:56.510375 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:56.510849 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:56.511375 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:56.650744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:56.664210 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:56.666766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:56.668009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c7aa3e5a-79bf-45a7-bfe0-81142e49b723 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.169731 Jun 16 17:37:56.668796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 231/464] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:56 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:57.685940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:57.686557 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:57.693084 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.693564 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.694324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.694763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.738730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:57.739322 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:57.746846 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.747293 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.748063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.748494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.771365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3b057659-0b22-421e-8c77-6fa0708363e4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/ips" status: 200 len: 148 microversion: 2.1 time: 0.037931 Jun 16 17:37:57.771945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 232/465] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:37:57 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:37:57.782625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d06d388-dd76-47d4-bd03-fd3d683e51bf"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:37:57.784021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:57.790269 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.791366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.792249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.792687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.843822 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:57.852785 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:57.857632 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:57.858828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7f36dd0b-0b56-49c3-9051-75617fde7308 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.176891 Jun 16 17:37:57.859403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 234/466] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:57 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:57.895417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: POST /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/os-volume_attachments HTTP/1.1 Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 74 Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:37:57.897432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {"volumeAttachment": {"volumeId": "0d06d388-dd76-47d4-bd03-fd3d683e51bf"}} Jun 16 17:37:57.898788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'server_id': '3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb', 'body': {'volumeAttachment': {'volumeId': '0d06d388-dd76-47d4-bd03-fd3d683e51bf'}}} Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:37:57.901970 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:37:57.904032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 400 to user: Invalid volume: volume 0d06d388-dd76-47d4-bd03-fd3d683e51bf is already attached to instances: e052a589-f2aa-4711-8beb-2171defad99e {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-60be55ac-8734-4f61-9f09-d406a191d6fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120275 Jun 16 17:37:57.905914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 233/467] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:37:57 2022] POST /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:37:57.910173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:57.910758 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:57.918571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.919110 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.920135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:57.920674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:57.949194 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:37:58.031552 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4899ed70-08ad-4e05-ac2b-ab081d7eb857 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 204 len: 0 microversion: 2.1 time: 0.126361 Jun 16 17:37:58.032154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 235/468] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:37:57 2022] DELETE /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:37:58.040168 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:58.041468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:58.048560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:58.049002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:58.049799 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:58.050229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:58.186687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:58.194377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-57770a9b-44fd-42f8-9eee-a95ff80176cf tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.157936 Jun 16 17:37:58.194947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 234/469] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:58 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:37:58.879285 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:58.879978 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:58.886755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:58.887206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:58.887967 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:58.888400 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:59.068548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:59.078192 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:59.079703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:59.080859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-386a9194-2ed1-4598-b2e5-cf6035a86660 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.205919 Jun 16 17:37:59.081620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 236/470] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:37:58 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:37:59.213749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:37:59.214737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:37:59.221512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:59.222074 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:59.222946 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:37:59.223482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:37:59.372148 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:37:59.380034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a8a1c8d5-a87a-42c3-830d-a29e816e4685 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.171721 Jun 16 17:37:59.380603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 235/471] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:37:59 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:00.099887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:00.100722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:00.107252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.107699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:00.108465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.108900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:00.265117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:00.276712 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:00.278287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:00.279733 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-92ad5140-e50a-4ff6-95d3-4d400d316cd0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.183473 Jun 16 17:38:00.297925 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 237/472] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:00 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:00.396643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:00.397445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:00.405105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.406175 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:00.406556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.407086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:00.543755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:00.551340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ce96c8ea-65f3-426e-a030-489427e6dbf5 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.158611 Jun 16 17:38:00.551985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 236/473] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:00 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:00.977690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:00.979283 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:00.985908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.986624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:00.987561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:00.988146 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:01.122897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lazy-loading 'services' on Instance uuid 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:38:01.257663 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a162f2bd-0fab-4bdd-95d4-3684314f7e68 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments/522899a8-9f5b-4135-82ce-99d3a0b88e43" status: 202 len: 0 microversion: 2.1 time: 0.283901 Jun 16 17:38:01.258308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 238/474] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:38:00 2022] DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments/522899a8-9f5b-4135-82ce-99d3a0b88e43 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:38:01.308855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:01.309603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:01.318560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:01.329805 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:01.330658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:01.331105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:01.476834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:01.488634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:01.490315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:01.491750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f1640ede-a262-434b-af27-09ab55697ff9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.187858 Jun 16 17:38:01.492307 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 237/475] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:01 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:01.570570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:01.571181 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:01.577615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:01.578059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:01.578809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:01.579241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:01.733878 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:01.741790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9a596c78-7e12-4ea5-82a2-29cafd841f24 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.175665 Jun 16 17:38:01.742363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 239/476] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:01 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:02.511834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:02.512407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:02.518743 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:02.519180 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:02.519934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:02.520356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:02.675365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:02.683950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:02.686107 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:02.687289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a2e9756e-d0a6-411a-9caa-ea51a34a5607 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.180187 Jun 16 17:38:02.687839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 238/477] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:02 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:38:02.760067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:02.760669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:02.767312 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:02.767880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:02.768651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:02.769089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:02.905340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:02.913055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e85d9739-feb1-4fe9-8a76-250de624cf78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.157022 Jun 16 17:38:02.913657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 240/478] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:02 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:03.705012 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:03.705671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:03.712109 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:03.712714 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:03.713443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:03.713783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:03.854336 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:03.862658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:03.864164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:03.865360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a3082879-52a3-4bbd-b41f-2898bafb714c tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.164231 Jun 16 17:38:03.866194 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 239/479] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:03 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:03.930269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:03.930876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:03.937768 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:03.938482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:03.939429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:03.940096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:04.081798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:04.085491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:04.092151 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-417cc890-b053-4f70-8176-4d7a8178bb98 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.165614 Jun 16 17:38:04.092977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 241/480] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:03 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:04.883964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:04.884902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:04.891284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:04.891753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:04.892516 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:04.892950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:05.029826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:05.038576 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:05.040163 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:05.042115 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-dd9044ca-ac0b-4c0d-92e3-6b41d46247f9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.162069 Jun 16 17:38:05.042739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 240/481] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:04 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:38:05.109903 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:05.110509 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:05.118241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:05.118747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:05.119650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:05.120085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:05.284851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:05.292620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-56fc2f34-c113-4059-919e-ee815c187405 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.186507 Jun 16 17:38:05.293214 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 242/482] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:05 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:06.063072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:06.063793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:06.070969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:06.071560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:06.073104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:06.073565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:06.208304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:06.217854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:06.219356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:06.220517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a2b0a63a-742b-4ab0-8dc1-f7a55cb54cad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.161972 Jun 16 17:38:06.221073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 241/483] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:06 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:06.310125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:06.310729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:06.317228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:06.317682 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:06.318447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:06.318886 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:06.452960 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:06.461268 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ed603efc-5565-4322-9118-e4c4932ed86d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.155560 Jun 16 17:38:06.461851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 243/484] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:06 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:07.239825 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:07.240734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:07.247878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:07.248323 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:07.249093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:07.249566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:07.388461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:07.397331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:07.398832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:07.400661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4a2dd626-8572-4e85-9b4e-6e57b3c82ceb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.164147 Jun 16 17:38:07.401781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 242/485] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:07 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:07.480739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:07.481431 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:07.488669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:07.489103 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:07.489971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:07.491189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:07.626872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:07.634957 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ba796566-7c4e-4502-8924-9a00a909949e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.158139 Jun 16 17:38:07.635530 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 244/486] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:07 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:08.418843 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:08.419446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:08.426044 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:08.426490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:08.427250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:08.427688 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:08.432600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:08.564370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:08.573702 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:08.575229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:08.576368 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-599f1929-fb93-4c98-b8ec-5bed6960f253 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.161911 Jun 16 17:38:08.576920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 243/487] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:08 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:08.651915 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:08.652520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:08.659080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:08.659527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:08.660278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:08.660711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:08.795924 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:08.803337 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fbdf76cf-8a6b-40ee-90db-9829ecf1d376 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.155469 Jun 16 17:38:08.803899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 245/488] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:08 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:09.594451 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.595076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:09.601444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:09.601881 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:09.602624 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:09.603620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:09.733954 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:09.742523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:09.744031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:09.745190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-93bffdca-c185-4326-ae80-ee3d776a7d88 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.154559 Jun 16 17:38:09.745748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 244/489] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:09.821302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:09.822059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:09.828580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:09.829022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:09.829809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:09.830241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:09.958503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:09.968155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-127cbf93-68de-4ea0-930c-04c8f2fdbf0c tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.150588 Jun 16 17:38:09.968736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 246/490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:09 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:10.765079 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:10.765727 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:10.772314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:10.772699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:10.773506 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:10.773947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:10.922449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:10.932274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:10.933869 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:10.935041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-93a6f95f-8d27-4c9c-9571-fe93b22aadf2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.175074 Jun 16 17:38:10.945943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 245/491] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:10 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:10.985528 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:10.986325 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:10.993309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:10.993762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:10.994613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:10.995053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:11.384035 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:11.392198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cd8418c5-0d11-4153-bf71-ccdd2c184194 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 200 len: 1680 microversion: 2.1 time: 0.410618 Jun 16 17:38:11.392773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 247/492] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:10 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:11.509337 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-ff9ebb8b-dd0f-4eb3-a002-b95b7515eede req-f9e234a2-7164-4595-a65e-57eb58881af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb", "name": "network-vif-deleted", "tag": "42876d97-ab72-447f-9723-b8c55e7cd05c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:11.519174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ff9ebb8b-dd0f-4eb3-a002-b95b7515eede req-f9e234a2-7164-4595-a65e-57eb58881af7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:11.519836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ff9ebb8b-dd0f-4eb3-a002-b95b7515eede req-f9e234a2-7164-4595-a65e-57eb58881af7 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:11.533680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-ff9ebb8b-dd0f-4eb3-a002-b95b7515eede req-f9e234a2-7164-4595-a65e-57eb58881af7 service nova] Creating event network-vif-deleted:42876d97-ab72-447f-9723-b8c55e7cd05c for instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb on hv-cinder-83754 Jun 16 17:38:11.539935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-ff9ebb8b-dd0f-4eb3-a002-b95b7515eede req-f9e234a2-7164-4595-a65e-57eb58881af7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034131 Jun 16 17:38:11.541717 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 246/493] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:11.930804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e2e95940-63fc-4022-b20c-78286a3fa8de tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:11.937174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2e95940-63fc-4022-b20c-78286a3fa8de tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:11.937646 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e2e95940-63fc-4022-b20c-78286a3fa8de tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:11.956961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:11.959048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:11.979529 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:11.982458 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:11.983362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:11.985697 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:12.004110 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e2e95940-63fc-4022-b20c-78286a3fa8de tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Going to try to stop instance {{(pid=124161) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 17:38:12.069430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e2e95940-63fc-4022-b20c-78286a3fa8de tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action" status: 202 len: 0 microversion: 2.1 time: 0.142254 Jun 16 17:38:12.074030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 248/494] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:38:11 2022] POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:38:12.094758 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:12.095471 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:12.106505 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:12.107724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:12.109541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:12.109994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:12.245569 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:12.261181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:12.263057 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:12.264549 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1b27fa1a-4376-4fb1-8273-d78f2a667b02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.314377 Jun 16 17:38:12.265798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 247/495] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:11 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:12.318587 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:12.326663 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d22b4b33-7f48-403b-8264-22b76ed84802 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.236587 Jun 16 17:38:12.327244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 249/496] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:12 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:12.409959 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:12.411146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:12.422686 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:12.423141 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:12.423928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:12.424362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:12.439593 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb HTTP/1.1 Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:38:12.441283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:38:12.443007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb'} Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:38:12.444020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:38:12.445615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:38:12.447142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:38:12.447142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8adb6ca5-e83f-4976-afad-a0f6a8198b70 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 404 len: 111 microversion: 2.1 time: 0.036557 Jun 16 17:38:12.447142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 248/497] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:12 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:38:12.452455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7ee4927b-9c75-4bfe-89fe-9bbb48ffe875 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '.version_select at 0x7f84aa326dc0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:12.473485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7ee4927b-9c75-4bfe-89fe-9bbb48ffe875 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622175028" status: 202 len: 0 microversion: 2.1 time: 0.024779 Jun 16 17:38:12.474347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 250/498] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jun 16 17:38:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622175028 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:38:13.283796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:13.284405 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:13.292393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.292777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.293783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.294212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.344927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:13.346446 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:13.355762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.356444 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.357384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.358058 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.489709 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:13.498733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:13.500171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:13.501360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8f49d8ce-1d50-419c-a09b-5b096a3a8a63 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.221563 Jun 16 17:38:13.501910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 249/499] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:13 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:13.506905 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:13.506905 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:13.514340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.514784 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.515749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.516182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.531868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:13.539339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7ba95925-05aa-48fd-9e5c-8dce15566a04 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.198755 Jun 16 17:38:13.539893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 251/500] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:13 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:13.641750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lazy-loading 'services' on Instance uuid e052a589-f2aa-4711-8beb-2171defad99e {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:38:13.762848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-dcebd582-46ff-43a9-82a1-ad22fdf986df tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments/0d06d388-dd76-47d4-bd03-fd3d683e51bf" status: 202 len: 0 microversion: 2.1 time: 0.259632 Jun 16 17:38:13.763356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 250/501] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:38:13 2022] DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments/0d06d388-dd76-47d4-bd03-fd3d683e51bf => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:38:13.771619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:13.772551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:13.781199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.781643 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.782476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:13.782922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:13.824623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-131bd6f9-3491-46bd-afc6-78ffbe77e3de tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056858 Jun 16 17:38:13.825230 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 252/502] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:38:13 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:14.522034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:14.522720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:14.535098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.535549 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.536325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.536765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.557982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:14.558605 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:14.565171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.565622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.566381 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.566811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.734278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:14.745713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:14.747335 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:14.748599 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-165f3500-f295-47df-8e4a-bdeefd3806af tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.231439 Jun 16 17:38:14.751989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:14.761030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d2081b2c-9218-4670-996c-2d3168b1cc02 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.207407 Jun 16 17:38:14.761687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 253/503] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:14 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:14.761833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 251/504] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:14 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:14.836387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:14.837584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:14.843585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.844027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.844786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.845247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.874156 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a42714a3-22f4-4152-9f90-8ec9fc6b8f66 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041741 Jun 16 17:38:14.874715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 254/505] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:38:14 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:38:14.932510 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:14.933005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:14.939012 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.939457 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.940219 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:14.940652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:14.966188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:38:15.050416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-77c57c8b-1303-4174-a6d0-b59f93a79746 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 204 len: 0 microversion: 2.1 time: 0.122658 Jun 16 17:38:15.050978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 252/506] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:38:14 2022] DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:38:15.059786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:15.060387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:15.066305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.066744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.067491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.067916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.216467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:15.223900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-aadd7681-164c-4414-824e-8a0b55bae406 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1681 microversion: 2.1 time: 0.168642 Jun 16 17:38:15.224477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 255/507] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:15 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:15.776186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:15.776840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:15.778538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:15.779189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:15.784920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.785393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.785662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.786117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.786217 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.786573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.786887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:15.787325 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:15.985230 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:15.988374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:15.993631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fefa0121-2a23-4871-960c-3aec8c08b58e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.218831 Jun 16 17:38:15.994279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 256/508] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:15 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:15.998405 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:15.999902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:16.001047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c79bb588-72ae-43a7-a67f-b875363bbdbc tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.229268 Jun 16 17:38:16.001618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 253/509] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:15 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:16.242324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:16.243669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:16.249732 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:16.250171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:16.250919 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:16.251348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:16.378857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:16.386565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b5b3d9b3-773c-44d4-9451-4628f02369d7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1681 microversion: 2.1 time: 0.148395 Jun 16 17:38:16.387142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 257/510] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:16 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:16.556506 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebdb7ec7-6b91-48cb-ab8d-446875b70d23"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:16.557684 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:16.563656 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:16.564099 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:16.564853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:16.565322 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.010925 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:17.011467 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:17.018021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.018468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.019229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.019664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.038720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:17.153796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:17.161297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-14f5a066-50cf-4e7e-beaf-a8359e5ec18d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.154928 Jun 16 17:38:17.161869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 258/511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:17 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:17.167927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:17.168832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:17.170707 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:17.175907 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.176358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.177136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.177597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.312245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:17.320612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:17.322776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:17.323942 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2eb040f8-fd36-4661-b88f-e46b0f7bf8ad tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.161159 Jun 16 17:38:17.324496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 259/512] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:17 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:17.404461 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:17.405062 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:17.411009 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.411453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.412209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:17.412636 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:17.553569 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:17.562091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6f7cfe3d-05f0-4a73-8338-0392eb09d10f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1681 microversion: 2.1 time: 0.161810 Jun 16 17:38:17.562671 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 260/513] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:17 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:18.174057 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d3974aa0-7502-43eb-8ea4-68ff8e8c7747 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621553 Jun 16 17:38:18.174921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 254/514] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:38:16 2022] POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 194 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:18.182037 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:18.182828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:18.189782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.190233 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.191100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.191529 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.344439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:18.345513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:18.354891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.356234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.357285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.357935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.368842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:18.379590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9ad74cd6-09e8-4653-bb08-ec2f098b8eb9 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.202937 Jun 16 17:38:18.380451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 261/515] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:18 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:18.505474 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:18.514212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:18.515744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:18.516882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a4963b46-1f71-4e2b-9f63-b83eb17602c8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.177769 Jun 16 17:38:18.517467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 255/516] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:18 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:18.579902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:18.580457 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:18.586487 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.588024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.588614 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:18.589055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:18.724939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:18.733761 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-93af7cfb-4158-4a7b-95bf-04344b57f852 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 200 len: 1681 microversion: 2.1 time: 0.157732 Jun 16 17:38:18.743820 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 262/517] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:18 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:19.113250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-067be018-0d73-4e1b-97cd-f7fffb9f6625 req-4db961c3-4901-417a-a198-79e8159aa5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e052a589-f2aa-4711-8beb-2171defad99e", "name": "network-vif-deleted", "tag": "34435ad7-815c-4541-888a-58d96e70159f"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:19.124256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-067be018-0d73-4e1b-97cd-f7fffb9f6625 req-4db961c3-4901-417a-a198-79e8159aa5cf service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.124730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-067be018-0d73-4e1b-97cd-f7fffb9f6625 req-4db961c3-4901-417a-a198-79e8159aa5cf service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.139420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-067be018-0d73-4e1b-97cd-f7fffb9f6625 req-4db961c3-4901-417a-a198-79e8159aa5cf service nova] Creating event network-vif-deleted:34435ad7-815c-4541-888a-58d96e70159f for instance e052a589-f2aa-4711-8beb-2171defad99e on hv-cinder-83754 Jun 16 17:38:19.144509 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-067be018-0d73-4e1b-97cd-f7fffb9f6625 req-4db961c3-4901-417a-a198-79e8159aa5cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Jun 16 17:38:19.145660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 256/518] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:19.398538 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:19.400213 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:19.410487 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.410972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.411883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.412387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.536932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:19.538319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:19.545378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.545820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.546589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.547043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.558755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:19.569001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1dea49e5-be9d-44f5-8edb-9ebbcd8fc9ba tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.174279 Jun 16 17:38:19.570022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 263/519] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:19 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:19.704554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:19.716469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:19.718155 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:19.719424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-428c73da-dd11-4603-8c55-48e1ac966cb3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.187222 Jun 16 17:38:19.720386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 257/520] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:19 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:19.751456 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:19.752647 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:19.760592 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.761470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.762655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:19.763331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:19.780928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e HTTP/1.1 Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:38:19.782912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:38:19.784223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'e052a589-f2aa-4711-8beb-2171defad99e'} Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:38:19.784959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:38:19.787140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:19.789484 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:38:19.789484 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d578c3ba-795f-4bfb-844e-c039d509d976 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 404 len: 111 microversion: 2.1 time: 0.037047 Jun 16 17:38:19.789484 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 264/521] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:19 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:38:19.794702 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0a20e90c-f60a-452e-a02a-c1bddb5ada82 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '.version_select at 0x7f84aa43d3a0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:19.817643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0a20e90c-f60a-452e-a02a-c1bddb5ada82 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845832376" status: 202 len: 0 microversion: 2.1 time: 0.028151 Jun 16 17:38:19.818153 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 258/522] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845832376 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:38:20.500907 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-da63723f-9554-4acd-8147-ad723ad997ec tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: .version_select at 0x7f84aa519dc0>, body: {"keypair": {"name": "tempest-keypair-1240930818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh9+R/azcc1LZtVit2e+rfY7atWy7r+lmwPfYWSnf+4naXiS2HYKgCDtNBM3h+bhu/Q59rIULcCE6AKUz2tHq9Aze8bJ5h4nkjApM1dmbCo3I71rc2htCucTbcDnxoTGg=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:20.517139 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-da63723f-9554-4acd-8147-ad723ad997ec tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:38:20.521124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-da63723f-9554-4acd-8147-ad723ad997ec tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:38:20.543911 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-da63723f-9554-4acd-8147-ad723ad997ec tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046843 Jun 16 17:38:20.544506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 265/523] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:38:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:38:20.588243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:20.588860 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:20.595627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:20.596102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:20.596898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:20.597351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:20.602053 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:20.749968 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:20.752506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:20.765453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:20.766045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:20.766985 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:20.767501 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:20.804341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:20.827376 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d097f05f-298c-4922-807f-f262a53bf7c3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.242983 Jun 16 17:38:20.828305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 259/524] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:20 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:20.866215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-bdf4b330-7961-4bf2-985b-626d45879e99 req-7b404f2c-8d02-4785-ab01-060504e78763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "name": "network-vif-plugged", "status": "completed", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:20.876077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-bdf4b330-7961-4bf2-985b-626d45879e99 req-7b404f2c-8d02-4785-ab01-060504e78763 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:20.876631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-bdf4b330-7961-4bf2-985b-626d45879e99 req-7b404f2c-8d02-4785-ab01-060504e78763 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:20.892797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-bdf4b330-7961-4bf2-985b-626d45879e99 req-7b404f2c-8d02-4785-ab01-060504e78763 service nova] Creating event network-vif-plugged:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:38:20.898576 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-bdf4b330-7961-4bf2-985b-626d45879e99 req-7b404f2c-8d02-4785-ab01-060504e78763 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036495 Jun 16 17:38:20.900221 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 260/525] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:20.975323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:20.987700 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:20.989370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:20.990808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-518ab9a9-bc61-4427-9ff2-1436c25b5428 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.255704 Jun 16 17:38:20.991364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 266/526] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:20 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:21.846616 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:21.847445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:21.854571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:21.855114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:21.855974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:21.856461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:22.011403 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:22.011754 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:22.012433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:22.019401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:22.019517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-19657002-71c0-4677-b933-5f72ce2daccb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1677 microversion: 2.1 time: 0.177760 Jun 16 17:38:22.019986 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:22.020824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:22.021297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:22.030033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 261/527] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:21 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:22.088844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1257583298", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb674c9-6bb7-4c32-892c-b28837e89812"}], "security_groups": [{"name": "tempest-securitygroup--1738597944"}], "key_name": "tempest-keypair-1240930818", "user_data": "}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:22.165500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:22.174275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:22.175934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:22.177096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b120c1da-61f5-4dae-9e9c-db42e7a9ef1a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.170505 Jun 16 17:38:22.177676 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 267/528] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:22 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:38:22.198820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] validate_networks() for [('6fb674c9-6bb7-4c32-892c-b28837e89812', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:38:22.572913 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:38:22.573490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:38:22.574327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:38:22.574732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:38:22.575262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:38:22.585522 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:22.586073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:22.587600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:22.588028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:22.606019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:38:22.610560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:38:22.622118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:38:22.624354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:38:22.669177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3d94f1e9-58bc-465d-bdfc-7a94f68ad794 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585127 Jun 16 17:38:22.669832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 262/529] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:38:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:38:22.679904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8b75b765-5e75-4ad8-a147-ff16a456a3dc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:22.682058 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8b75b765-5e75-4ad8-a147-ff16a456a3dc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:22.737106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8b75b765-5e75-4ad8-a147-ff16a456a3dc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:22.744982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8b75b765-5e75-4ad8-a147-ff16a456a3dc tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1242 microversion: 2.1 time: 0.068995 Jun 16 17:38:22.745586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 268/530] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:22 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:23.036859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:23.037712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:23.045442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.046098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.047137 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.048145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.187150 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.195149 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5bb961ad-30e8-4a79-b3e8-cd5983e12558 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1654 microversion: 2.1 time: 0.162706 Jun 16 17:38:23.196290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 263/531] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:23 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:23.205271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:23.206112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:23.214708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1fe5c86a-2122-4ac0-9402-3b70ac212099 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:23.215359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.215975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.217062 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.217734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.222268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1fe5c86a-2122-4ac0-9402-3b70ac212099 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.222851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1fe5c86a-2122-4ac0-9402-3b70ac212099 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.249491 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1fe5c86a-2122-4ac0-9402-3b70ac212099 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Going to try to start instance {{(pid=124160) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 17:38:23.302682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1fe5c86a-2122-4ac0-9402-3b70ac212099 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action" status: 202 len: 0 microversion: 2.1 time: 0.094022 Jun 16 17:38:23.303281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 264/532] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:38:23 2022] POST /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:38:23.315197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:23.315916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:23.322802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.323496 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.324636 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.325755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.365311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.378470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.381279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.385512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4b96d4ad-d35f-4f0b-a30b-d16714a61e5d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1809 microversion: 2.20 time: 0.191313 Jun 16 17:38:23.387014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 269/533] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:23 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:38:23.493932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.503243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-91e1a74a-6822-423d-8381-ee0c8717c8c4 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1663 microversion: 2.1 time: 0.194148 Jun 16 17:38:23.503759 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 265/534] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:23 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1663 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:23.762029 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:23.762560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:23.768643 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.769097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.769900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:23.770341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:23.838896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:23.846309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-61871981-e61f-425f-8fae-cff4ff8f3d72 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1294 microversion: 2.1 time: 0.089192 Jun 16 17:38:23.846865 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 270/535] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:23 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:24.403897 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:24.404468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:24.406855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:24.412150 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.412584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.413358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.413933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.523570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:24.524871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:24.534064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.535405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.536976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.537735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.688311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:24.697800 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:24.699344 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:24.700497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e1389cdf-610d-49c0-9c12-1388f0921ac8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1796 microversion: 2.20 time: 0.300546 Jun 16 17:38:24.701054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 266/536] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:38:24 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1796 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:38:24.757971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:24.766201 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-00573735-6ff9-46b1-a233-f0655c576f3c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1663 microversion: 2.1 time: 0.247456 Jun 16 17:38:24.766778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 271/537] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:24 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1663 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:24.863712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:24.864313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:24.870700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.871145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.871903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:24.872332 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:24.950539 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:24.968424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5d319727-4862-47e2-baf5-f84d24a24eb8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1312 microversion: 2.1 time: 0.106831 Jun 16 17:38:24.979827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 267/538] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:24 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:25.751482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:25.752498 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:25.760756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.761231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:25.762004 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.762634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:25.785014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:25.785830 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:25.786765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'flavor' on Instance uuid 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:38:25.803313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.803829 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:25.804701 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.805310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:25.916832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9f3426da-a53f-45f5-b3ce-7d7f62e21777 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/action" status: 200 len: 32 microversion: 2.1 time: 0.169271 Jun 16 17:38:25.917501 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 272/539] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:38:25 2022] POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:38:25.926659 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:25.927357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:25.938218 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.938669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:25.939453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:25.939889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:26.077583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:26.085034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3bfe3ac9-06e2-42a0-a084-d8706c5267d6 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1663 microversion: 2.1 time: 0.304077 Jun 16 17:38:26.085640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 268/540] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:25 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1663 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:26.091295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:26.092104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:26.098543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:26.098995 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:26.099771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:26.100207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:26.227616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:26.241780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1cd86bf8-9dca-481c-9167-56c68ff8cd30 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.318871 Jun 16 17:38:26.244606 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 273/541] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:25 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:26.378976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:26.390678 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aeb6efc0-5934-46e8-899d-f2bb6934167f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.303237 Jun 16 17:38:26.391271 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 269/542] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:26 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:26.551367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-7f2bc577-06df-471b-82f1-76ccb7eed61b req-2b5fdb91-2ba9-42b3-bbd2-f644432fb14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84a8707-8182-47fa-b359-249a10a44e48", "tag": "5216b201-175c-4137-a731-eefb03a0fd37"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:26.564317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7f2bc577-06df-471b-82f1-76ccb7eed61b req-2b5fdb91-2ba9-42b3-bbd2-f644432fb14f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:26.564773 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7f2bc577-06df-471b-82f1-76ccb7eed61b req-2b5fdb91-2ba9-42b3-bbd2-f644432fb14f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:26.583532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-7f2bc577-06df-471b-82f1-76ccb7eed61b req-2b5fdb91-2ba9-42b3-bbd2-f644432fb14f service nova] Creating event network-changed:5216b201-175c-4137-a731-eefb03a0fd37 for instance a84a8707-8182-47fa-b359-249a10a44e48 on hv-cinder-83754 Jun 16 17:38:26.591648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-7f2bc577-06df-471b-82f1-76ccb7eed61b req-2b5fdb91-2ba9-42b3-bbd2-f644432fb14f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Jun 16 17:38:26.592855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 274/543] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:27.103052 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:27.103681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:27.110120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.110625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.111581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.112030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.241093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:27.249425 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4a31bd40-e1cd-4396-8f9d-ce2731c98900 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1667 microversion: 2.1 time: 0.150358 Jun 16 17:38:27.249994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 270/544] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:27 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:27.263787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:27.264490 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:27.271163 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.271620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.272384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.272825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.406859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:27.408841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:27.409465 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:27.415070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1f8a3384-0adf-4654-82f2-4273906039ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.155391 Jun 16 17:38:27.415459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.416430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 275/545] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:27 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:27.416562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.416993 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:27.417443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:27.547646 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:27.555029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b5f14d39-dd40-4805-96a8-d1db36d09985 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.149817 Jun 16 17:38:27.556175 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 271/546] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:27 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:28.432095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:28.433397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:28.440015 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:28.440466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:28.441266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:28.441711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:28.460340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:28.572748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:28.573722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:28.581799 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:28.582245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:28.583805 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:28.588340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:28.978844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:28.986390 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:28.986815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9e853035-b5be-419f-a6ed-23fdfa6f4422 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.558828 Jun 16 17:38:28.987391 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 276/547] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:28 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:28.995270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d9784b7f-e7ee-457b-a221-e50796bde9e9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.426473 Jun 16 17:38:29.004313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 272/548] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:28 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:30.005877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:30.006540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:30.012695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:30.013346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:30.013674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:30.014124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:30.014885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:30.015319 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:30.019690 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:30.020134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:30.020901 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:30.021360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:30.214045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:30.216681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:30.221952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c75461a0-5cc7-465f-bd2c-aa9b3af3c47b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.219955 Jun 16 17:38:30.222529 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 277/549] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:30 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:30.224485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3fe4b136-d9cf-4b9a-ad15-100b45f4fd28 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.216341 Jun 16 17:38:30.225054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 273/550] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:30 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:31.240532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:31.241206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:31.247197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:31.247994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:31.254005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:31.254447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:31.254710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:31.255169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:31.255290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:31.255634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:31.255951 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:31.256404 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:31.478559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:31.481596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:31.486167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d34bbbec-9fbd-4d34-b11c-3e240e4f7d73 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.245325 Jun 16 17:38:31.486867 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 274/551] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:31 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:31.489743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ab5ebe4f-5156-4d2e-88e3-2cdce593239e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.254046 Jun 16 17:38:31.490242 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 278/552] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:31 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:32.503990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:32.504523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:32.506830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:32.507684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:32.512147 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:32.512592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:32.513403 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:32.513836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:32.515889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:32.516414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:32.517213 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:32.517689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:32.597268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:32.617233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=6 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:32.716582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:32.723547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:32.724360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-535c8c74-285a-426d-895e-0b921fb59c8a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.224407 Jun 16 17:38:32.724934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 275/553] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:32 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:32.733138 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-36954d23-c1c3-4af4-b7e1-58f196936715 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.230164 Jun 16 17:38:32.733734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 279/554] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:32 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:32.900287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-3be2dd66-dae5-4eb9-a8f7-baefeb51a0e6 req-ac887352-b0c3-4ad3-9c5f-c296ceb1a648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84a8707-8182-47fa-b359-249a10a44e48", "name": "network-vif-plugged", "status": "completed", "tag": "5216b201-175c-4137-a731-eefb03a0fd37"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:32.909172 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-3be2dd66-dae5-4eb9-a8f7-baefeb51a0e6 req-ac887352-b0c3-4ad3-9c5f-c296ceb1a648 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:32.910206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-3be2dd66-dae5-4eb9-a8f7-baefeb51a0e6 req-ac887352-b0c3-4ad3-9c5f-c296ceb1a648 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:32.914845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:32.927731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-3be2dd66-dae5-4eb9-a8f7-baefeb51a0e6 req-ac887352-b0c3-4ad3-9c5f-c296ceb1a648 service nova] Creating event network-vif-plugged:5216b201-175c-4137-a731-eefb03a0fd37 for instance a84a8707-8182-47fa-b359-249a10a44e48 on hv-cinder-83754 Jun 16 17:38:32.933382 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-3be2dd66-dae5-4eb9-a8f7-baefeb51a0e6 req-ac887352-b0c3-4ad3-9c5f-c296ceb1a648 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037987 Jun 16 17:38:32.934363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 276/555] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:33.742471 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:33.743076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:33.744754 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=6 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:33.750535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:33.750982 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:33.751765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:33.752187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:33.754911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:33.755635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:33.764068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:33.764519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:33.765320 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:33.765760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:33.959122 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:33.962093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:33.968049 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b9bb575e-fac7-44b8-b132-75ad159da9fd tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.229831 Jun 16 17:38:33.968831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 280/556] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:33 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:33.970234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a2fa7421-604f-4de8-982d-00f6c8141fda tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.219642 Jun 16 17:38:33.970800 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 277/557] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:33 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:34.985859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:34.986522 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:34.986836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:34.988041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:34.994641 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:34.995095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:34.995875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:34.996345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:34.996752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:34.997219 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:34.998250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:34.998683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:35.207429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:35.209507 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:35.219691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f12e4e5c-e382-492a-94b5-3d8f86409f5b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.236521 Jun 16 17:38:35.220683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 278/558] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:34 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:35.223083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9a3820ab-b252-4525-ba97-bdd5642a4c87 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1368 microversion: 2.1 time: 0.241289 Jun 16 17:38:35.225187 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 281/559] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:34 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:36.238110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:36.238722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:36.242077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:36.242776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:36.245451 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.245899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.246669 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.247102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.249231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.249678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.250432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.250862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.447803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:36.455375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:36.456021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-177ccf91-8726-4fda-a08f-939952dc82fa tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.221751 Jun 16 17:38:36.456611 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 279/560] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:36 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:36.466386 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-df40fae2-d6d6-4f63-b49b-032270cfaf40 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1558 microversion: 2.1 time: 0.228425 Jun 16 17:38:36.466987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 282/561] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:36 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:36.482899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:36.486121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:36.490053 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.490444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.491212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:36.491703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:36.570058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ec6503f5-8ae6-414d-a253-b67f1195eb11 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090922 Jun 16 17:38:36.570987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 280/562] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:38:36 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:37.486717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:37.487598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:37.495516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:37.496199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:37.497006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:37.498195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:37.527026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-16cf51b7-c715-4150-99ca-6ce21b8d88bc req-bceedf4c-4969-4b98-8bfb-5786f62ba5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84a8707-8182-47fa-b359-249a10a44e48", "tag": "5216b201-175c-4137-a731-eefb03a0fd37"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:37.538585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-16cf51b7-c715-4150-99ca-6ce21b8d88bc req-bceedf4c-4969-4b98-8bfb-5786f62ba5ec service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:37.539915 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-16cf51b7-c715-4150-99ca-6ce21b8d88bc req-bceedf4c-4969-4b98-8bfb-5786f62ba5ec service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:37.552368 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-16cf51b7-c715-4150-99ca-6ce21b8d88bc req-bceedf4c-4969-4b98-8bfb-5786f62ba5ec service nova] Creating event network-changed:5216b201-175c-4137-a731-eefb03a0fd37 for instance a84a8707-8182-47fa-b359-249a10a44e48 on hv-cinder-83754 Jun 16 17:38:37.558443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-16cf51b7-c715-4150-99ca-6ce21b8d88bc req-bceedf4c-4969-4b98-8bfb-5786f62ba5ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 Jun 16 17:38:37.559446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 281/563] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:37.650030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:37.658028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-990885a8-ffaa-41e3-8233-40fe40870563 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.182792 Jun 16 17:38:37.658598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 283/564] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:37 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:38.676456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:38.677546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:38.684801 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:38.685388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:38.686223 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:38.686719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:38.819660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:38.828181 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8961ffe9-3882-4e6d-ae7b-4504b8763cf2 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.156628 Jun 16 17:38:38.828740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 282/565] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:38 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:39.845269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:39.845879 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:39.852835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:39.853242 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:39.854045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:39.854454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:39.987392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:39.996091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7caf4e0a-979b-4e32-af56-c770e8ab2694 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1734 microversion: 2.1 time: 0.154748 Jun 16 17:38:39.996686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 284/566] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:39 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:41.013883 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:41.014421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:41.020882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.021372 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.022130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.022565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.155005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:41.162823 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cef1aa4b-76c3-4538-b049-096b13f2ebea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1714 microversion: 2.1 time: 0.152912 Jun 16 17:38:41.163459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 283/567] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:41 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:38:41.266652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:41.267146 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:41.274221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.274662 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.275406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.275835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.356266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 while it is in vm_state rescued Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Request method failure captured: Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments/ebdb7ec7-6b91-48cb-ab8d-446875b70d23 HTTP/1.1 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mfxyiT9WKfMSFPJaojSJe8--KXr7L7nqmAZJmt-eZ_rxN89uFYZ0s6ZwdSHtzILeQt26Vf1ANnb3FFotcJOYeL-jRg_JylhkFBvmCZUCGzhTQzKL4EJm7iJTBTm1HJYlbP83QdnrK1lJ9Bib2x46YrqsGnqvZoLRiBixNANE2nYZ0 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:38:41.357904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1c1d13142434356ac1210f14dad847b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1c1d13142434356ac1210f14dad847b"}]}] Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: a5c37b79bf3d40f4a6182cc296585c18 Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:38:41.359568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Cannot 'detach_volume' instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 while it is in vm_state rescued Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'server_id': '2d1c168b-5f64-4d47-ae45-8a006f09dfe1', 'id': 'ebdb7ec7-6b91-48cb-ab8d-446875b70d23'} Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:38:41.360420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 while it is in vm_state rescued Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 while it is in vm_state rescued Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:38:41.362000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Returning 409 to user: Cannot 'detach_volume' instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 while it is in vm_state rescued {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:38:41.363223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c79430a9-a88c-4628-9639-91c29fe35e82 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments/ebdb7ec7-6b91-48cb-ab8d-446875b70d23" status: 409 len: 152 microversion: 2.1 time: 0.096671 Jun 16 17:38:41.363223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 285/568] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:38:41 2022] DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments/ebdb7ec7-6b91-48cb-ab8d-446875b70d23 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 17:38:41.368753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:41.369353 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:41.375196 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.375637 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.376381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.376833 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.448713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-634c8286-c133-4d04-9f58-fe0c5e6d4a74 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/action" status: 202 len: 0 microversion: 2.1 time: 0.080467 Jun 16 17:38:41.452317 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 284/569] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:38:41 2022] POST /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:38:41.457473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:41.458323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:41.465821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.466265 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.467034 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:41.467465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:41.712410 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:41.720417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-33b9719e-fdd3-41dd-bcbb-c965c95151a8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1722 microversion: 2.1 time: 0.266706 Jun 16 17:38:41.720983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 286/570] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:41 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:42.745088 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:42.746536 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:42.753820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:42.754298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:42.755081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:42.755520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:42.935639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:42.945734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bf2d1170-e084-421a-af1f-6fdbf87d5cd5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1722 microversion: 2.1 time: 0.205326 Jun 16 17:38:42.946607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 285/571] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:42 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:43.968074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:43.968998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:43.978163 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:43.978617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:43.979560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:43.979882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:44.131224 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:44.141171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-35a0c7d2-d841-4553-91ae-3d3fa6da9b90 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1722 microversion: 2.1 time: 0.177682 Jun 16 17:38:44.141782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 287/572] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:43 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:45.163517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:45.164144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:45.171188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:45.171636 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:45.172418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:45.172852 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:45.339227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:38:45.373965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ad845ec7-0ee1-4eb3-ae65-832f0eb07521 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1728 microversion: 2.1 time: 0.213639 Jun 16 17:38:45.375151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 286/573] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:38:45 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:38:45.449087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:38:45.450230 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:38:45.465478 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:45.466098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:45.467040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:45.467617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:45.559618 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cd957c4c-a11c-4784-9e94-2e94fbc182fe tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129121 Jun 16 17:38:45.560474 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 288/574] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:38:45 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:38:46.868972 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-87dc40c3-0039-480a-82b2-72bd4d594650 req-04521b45-e84d-497f-93be-b7c27d49d2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:46.878583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-87dc40c3-0039-480a-82b2-72bd4d594650 req-04521b45-e84d-497f-93be-b7c27d49d2b0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:46.879021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-87dc40c3-0039-480a-82b2-72bd4d594650 req-04521b45-e84d-497f-93be-b7c27d49d2b0 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:46.891537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-87dc40c3-0039-480a-82b2-72bd4d594650 req-04521b45-e84d-497f-93be-b7c27d49d2b0 service nova] Creating event network-changed:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:38:46.899227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-87dc40c3-0039-480a-82b2-72bd4d594650 req-04521b45-e84d-497f-93be-b7c27d49d2b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Jun 16 17:38:46.899564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 287/575] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:38:48.915190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-9cb5991a-61ff-4d57-8864-ad961791cf9c req-3e60e150-cd47-4ea3-a3e9-7dfc2ab11b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:38:48.918704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:38:48.925054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9cb5991a-61ff-4d57-8864-ad961791cf9c req-3e60e150-cd47-4ea3-a3e9-7dfc2ab11b88 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:38:48.925527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9cb5991a-61ff-4d57-8864-ad961791cf9c req-3e60e150-cd47-4ea3-a3e9-7dfc2ab11b88 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:38:48.936901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-9cb5991a-61ff-4d57-8864-ad961791cf9c req-3e60e150-cd47-4ea3-a3e9-7dfc2ab11b88 service nova] Creating event network-changed:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:38:48.943472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-9cb5991a-61ff-4d57-8864-ad961791cf9c req-3e60e150-cd47-4ea3-a3e9-7dfc2ab11b88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031404 Jun 16 17:38:48.943472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 289/576] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:06.289087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=43 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:06.289847 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:06.294525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:06.295129 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:06.302436 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.302943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.303984 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.304411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.336383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5ba1da98-be77-4e84-a9cd-1dceb739c721 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments/e584a876-361d-4092-8e33-99369bc9d766" status: 200 len: 194 microversion: 2.20 time: 0.049030 Jun 16 17:39:06.336979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 288/577] 10.222.0.40 () {60 vars in 1453 bytes} [Thu Jun 16 17:39:06 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments/e584a876-361d-4092-8e33-99369bc9d766 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:39:06.398536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=74 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:06.399296 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:06.403624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:06.404247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:06.411433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.411888 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.412735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.413778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.497067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lazy-loading 'services' on Instance uuid ade4cabc-bd7b-4506-b836-9178181c78e2 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:06.571687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-48663300-e1e0-40ee-a542-ffdeb99f05c1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments/e584a876-361d-4092-8e33-99369bc9d766" status: 202 len: 0 microversion: 2.20 time: 0.175809 Jun 16 17:39:06.572367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 290/578] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jun 16 17:39:06 2022] DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments/e584a876-361d-4092-8e33-99369bc9d766 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:06.580963 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:06.581929 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:06.589046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.589583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.590441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:06.590954 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:06.623854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ce124e78-531a-4054-bbe8-87130ad96f29 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046932 Jun 16 17:39:06.624454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 289/579] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 17:39:06 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:39:07.636825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:07.637903 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:07.644105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.644545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:07.645342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.645770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:07.683687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f5ce4df2-2203-4648-8577-bd324a981ee9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051666 Jun 16 17:39:07.684245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 291/580] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 17:39:07 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:07.743438 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:07.744010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:07.750350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.750789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:07.751538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.751966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:07.779428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:07.863447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7eb1eebd-20fd-408e-a31e-83e2ffe223b5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 204 len: 0 microversion: 2.20 time: 0.123832 Jun 16 17:39:07.864211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 290/581] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 17:39:07 2022] DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:39:07.873259 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:07.873866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:07.880184 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.880730 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:07.882249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:07.882692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:08.020788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:08.029669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:08.031176 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:08.032335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9fac546d-cf72-4633-8cb6-1e1ac0fd6479 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.163003 Jun 16 17:39:08.032881 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 292/582] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:07 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:09.051478 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:09.052169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:09.059118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.059561 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.060321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.060749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.196137 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:09.204058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:09.205590 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:09.206742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bb6c0fa1-66f4-49ed-ad3d-9c0a94d526e4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.159582 Jun 16 17:39:09.207289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 291/583] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:09 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:09.335742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:09.336738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:09.343211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.343654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.344439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.344870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.374025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bf1e0169-7a78-4dd9-bf20-d50ee4473856 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042747 Jun 16 17:39:09.374580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 293/584] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:09 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:39:09.439489 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:09.440022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:09.447083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.447534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.448392 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.448827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.475543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:09.551527 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-715a2d33-853f-4dcb-9af0-567a5a295196 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 204 len: 0 microversion: 2.1 time: 0.115664 Jun 16 17:39:09.552113 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 292/585] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:09 2022] DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:09.560807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:09.561376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:09.567398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.567863 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.569324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:09.569977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:09.702855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:09.711622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-67d52385-0552-461b-92f2-8a5208f861cf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1673 microversion: 2.1 time: 0.154560 Jun 16 17:39:09.712215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 294/586] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:09 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:10.226789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:10.227481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:10.234178 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:10.234627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:10.235401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:10.235814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:10.376118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:10.384211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:10.385755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:10.386907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f29fb5ad-d311-4052-8ca4-d2af633cbe25 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.164961 Jun 16 17:39:10.387459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 293/587] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:10 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:10.729365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:10.729915 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:10.736588 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:10.737040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:10.738104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:10.738543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:10.922295 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:10.930240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8426c859-2d22-4ac9-b4bb-9db886c74a7c tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1673 microversion: 2.1 time: 0.204977 Jun 16 17:39:10.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 295/588] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:10 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:11.409272 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:11.410038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:11.417293 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:11.417659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:11.418430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:11.418861 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:11.619143 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:11.627327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:11.628855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:11.630033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2b9cdf41-e4b6-494e-9291-cc378fcf7f75 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1724 microversion: 2.20 time: 0.227291 Jun 16 17:39:11.630595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 294/589] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:11 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:11.948335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:11.948917 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:11.955032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:11.955480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:11.956241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:11.956670 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.165549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:12.175616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-008b1350-6c50-4c1b-aaa4-d3b500d9ba69 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 200 len: 1673 microversion: 2.1 time: 0.231549 Jun 16 17:39:12.189821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 296/590] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:11 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:12.549527 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-b4da14a0-2d72-4428-ac82-dd4d2c0771fc req-502a06dd-ac97-48d4-b389-23df5e4caaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade4cabc-bd7b-4506-b836-9178181c78e2", "name": "network-vif-deleted", "tag": "c5c2a113-9454-4de3-99aa-1df51b68633d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:12.554535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-b6d5dbbb-f9ed-4e60-9c70-087f213f77a1 req-351058c2-7a95-4d78-a634-69f66698bce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea8edce-fee8-4dbd-ae01-e4d060cf5597", "name": "network-vif-deleted", "tag": "4e13aef5-2de9-4312-9c58-333292fceaab"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:12.565140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b6d5dbbb-f9ed-4e60-9c70-087f213f77a1 req-351058c2-7a95-4d78-a634-69f66698bce3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:12.565915 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b6d5dbbb-f9ed-4e60-9c70-087f213f77a1 req-351058c2-7a95-4d78-a634-69f66698bce3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.577483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b4da14a0-2d72-4428-ac82-dd4d2c0771fc req-502a06dd-ac97-48d4-b389-23df5e4caaf5 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:12.581408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b4da14a0-2d72-4428-ac82-dd4d2c0771fc req-502a06dd-ac97-48d4-b389-23df5e4caaf5 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.587648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-b6d5dbbb-f9ed-4e60-9c70-087f213f77a1 req-351058c2-7a95-4d78-a634-69f66698bce3 service nova] Creating event network-vif-deleted:4e13aef5-2de9-4312-9c58-333292fceaab for instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 on hv-cinder-83754 Jun 16 17:39:12.600012 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-b6d5dbbb-f9ed-4e60-9c70-087f213f77a1 req-351058c2-7a95-4d78-a634-69f66698bce3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048613 Jun 16 17:39:12.600934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 297/591] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:12.602735 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-b4da14a0-2d72-4428-ac82-dd4d2c0771fc req-502a06dd-ac97-48d4-b389-23df5e4caaf5 service nova] Creating event network-vif-deleted:c5c2a113-9454-4de3-99aa-1df51b68633d for instance ade4cabc-bd7b-4506-b836-9178181c78e2 on hv-cinder-83754 Jun 16 17:39:12.610315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-b4da14a0-2d72-4428-ac82-dd4d2c0771fc req-502a06dd-ac97-48d4-b389-23df5e4caaf5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065848 Jun 16 17:39:12.610935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 295/592] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:12.650701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:12.652520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:12.661093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:12.662006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.663241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:12.664442 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.745941 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:12.748278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:12.749547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lazy-loading 'fault' on Instance uuid ade4cabc-bd7b-4506-b836-9178181c78e2 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:12.807270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:12.816454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:12.817998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:12.819870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4b1c3e7e-95b9-4c1f-8a2e-75b9514819ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 200 len: 1371 microversion: 2.20 time: 0.174436 Jun 16 17:39:12.822526 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 298/593] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:12 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:13.196222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:13.197350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:13.205822 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:13.206407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:13.207285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:13.207798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:13.244917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 HTTP/1.1 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:39:13.246902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:39:13.248277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '2ea8edce-fee8-4dbd-ae01-e4d060cf5597'} Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:13.249094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:39:13.250424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.253096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:13.254052 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3fb92633-b591-4056-ad55-86b5898b45d2 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 404 len: 111 microversion: 2.1 time: 0.062192 Jun 16 17:39:13.254695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 296/594] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:13 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:13.264594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8317a03a-7a4f-4972-bc58-f936f07b623a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '.version_select at 0x7f84aa311670>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:13.287102 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8317a03a-7a4f-4972-bc58-f936f07b623a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465592310" status: 202 len: 0 microversion: 2.1 time: 0.026417 Jun 16 17:39:13.288370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 299/595] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465592310 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:39:13.840721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:13.841397 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:13.848467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:13.848916 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:13.849789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:13.850211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:13.867072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 HTTP/1.1 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:39:13.869073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:39:13.871166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'ade4cabc-bd7b-4506-b836-9178181c78e2'} Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:13.873080 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:39:13.874682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:13.878048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:13.879114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-56af4806-bab8-4afc-9c90-eaed3b51e844 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 404 len: 111 microversion: 2.20 time: 0.042408 Jun 16 17:39:13.880289 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 297/596] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:13 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:39:13.890170 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-629a54e3-0ae5-4929-a50f-60b89f49537b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '.version_select at 0x7f84aa2ab0d0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:13.921704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-629a54e3-0ae5-4929-a50f-60b89f49537b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176793017" status: 204 len: 0 microversion: 2.20 time: 0.027150 Jun 16 17:39:13.923069 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 300/597] 10.222.0.40 () {60 vars in 1261 bytes} [Thu Jun 16 17:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176793017 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:39:14.298410 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5367dee1-d049-411d-b1ef-cfb8926a9edb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: .version_select at 0x7f84aa326790>, body: {"keypair": {"name": "tempest-keypair-1713570164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKcvoMWNw0T41pb52KX0bS5rat0muelhMq7Xp+X3g2Cp+0vTa8d9kysMMTFuUmIFE8vK90J0ai3eByHRl7LSp1S1N5ZyloQxFnHKkuU7aqW2gNbcdwh8cg8SpjEsmCHjA=="}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:14.312923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-5367dee1-d049-411d-b1ef-cfb8926a9edb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for project 4904f0e2f64e4bef989f441380e843b5. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:14.317398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-5367dee1-d049-411d-b1ef-cfb8926a9edb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for user 3faab41439184fecbb3e1021eb81d555 and project 4904f0e2f64e4bef989f441380e843b5. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:14.344098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5367dee1-d049-411d-b1ef-cfb8926a9edb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049495 Jun 16 17:39:14.344933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 298/598] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:39:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:14.883786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a68dfdfa-c1eb-4bd7-afde-f519bddf33e9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: .version_select at 0x7f84aa2ce310>, body: {"keypair": {"name": "tempest-keypair-647531770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRlg/DQ6VzJDn7/o01P9/XW5BMrJMcM2AnoEf5jOUvzOVXPYcG8f5hs56ZEBA/eGENToaAoxtol0NWhlbLhjZOd1PWIwx4/f67CwxbGlRwOb+dmjUGdq/5EwMksQHCHhg=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:14.899225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-a68dfdfa-c1eb-4bd7-afde-f519bddf33e9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:14.903195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-a68dfdfa-c1eb-4bd7-afde-f519bddf33e9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for user 2fbaf6d894e64f19bf041e7be20a6242 and project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:14.925056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a68dfdfa-c1eb-4bd7-afde-f519bddf33e9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045860 Jun 16 17:39:14.925696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 301/599] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jun 16 17:39:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 17:39:15.793274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1721691927", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7174c275-7bd9-4bad-898d-52e5729a7a31"}], "security_groups": [{"name": "tempest-securitygroup--339379848"}], "key_name": "tempest-keypair-1713570164", "user_data": "}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:16.007254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] validate_networks() for [('7174c275-7bd9-4bad-898d-52e5729a7a31', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:39:16.617342 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:39:16.617766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:39:16.618223 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:39:16.619292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:39:16.619870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:39:16.632730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:16.633210 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:16.633998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:16.634420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:16.650856 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2020426063", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cd693dc-5d6d-482c-a40c-9c9d0ef17994"}], "security_groups": [{"name": "tempest-securitygroup--166866395"}], "key_name": "tempest-keypair-647531770", "user_data": "}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:16.651443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for project 4904f0e2f64e4bef989f441380e843b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:16.655090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Getting quotas for user 3faab41439184fecbb3e1021eb81d555 and project 4904f0e2f64e4bef989f441380e843b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:16.667789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:39:16.670090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:39:16.724212 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-11dce85d-4c60-4c10-8c52-118159db2f4f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935170 Jun 16 17:39:16.725851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 299/600] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:39:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:39:16.735888 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e79f8a5e-eac4-478b-ad15-bea05e1063ac tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:16.736501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e79f8a5e-eac4-478b-ad15-bea05e1063ac tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:16.781868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] validate_networks() for [('3cd693dc-5d6d-482c-a40c-9c9d0ef17994', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:39:16.804818 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e79f8a5e-eac4-478b-ad15-bea05e1063ac tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:16.813776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e79f8a5e-eac4-478b-ad15-bea05e1063ac tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1238 microversion: 2.1 time: 0.081739 Jun 16 17:39:16.814379 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 300/601] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:16 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:17.214229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:39:17.214717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:39:17.215220 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:39:17.215634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:39:17.216043 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:39:17.225053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:17.225539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:17.226547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:17.226980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:17.247777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:17.252081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Getting quotas for user 2fbaf6d894e64f19bf041e7be20a6242 and project 34fb554e0cf14c7ab3a9f538273c289e. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:17.264658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:39:17.267013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:39:17.316895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-405e2752-cdc5-487f-937d-569be756f3eb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.671681 Jun 16 17:39:17.317901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 302/602] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jun 16 17:39:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 17:39:17.332898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:17.336229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:17.431234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:17.442279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:17.444047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:17.445228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1e9387f7-18da-4999-adb9-065ee2a734c9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1281 microversion: 2.20 time: 0.120645 Jun 16 17:39:17.445769 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 301/603] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:17 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:17.832417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:17.832948 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:17.840941 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:17.841481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:17.842332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:17.842721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:17.929553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:17.947446 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-67fdedf5-01c9-4bca-a45e-77e672c93072 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1308 microversion: 2.1 time: 0.118673 Jun 16 17:39:17.949195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 303/604] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:17 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:18.466934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:18.477716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:18.486305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:18.486895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:18.488110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:18.488651 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:18.593388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:18.607981 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:18.611035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:18.613990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3b46799f-9031-469f-aaf9-84e546359918 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1341 microversion: 2.20 time: 0.151197 Jun 16 17:39:18.618145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 302/605] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:18 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:18.970494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:18.973372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:18.984475 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:18.985275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:18.986465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:18.987254 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:19.309063 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:19.327244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-60440ba7-f534-4c17-982f-13d8e3130762 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.364161 Jun 16 17:39:19.328412 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 304/606] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:18 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:19.520391 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-a20802fe-7468-4e6b-bc13-2531ac2e9b5f req-4cfa2c41-a0d5-4c66-906f-38e44a47b080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd30c63b-c274-43bd-8322-7f51a2d51166", "tag": "97934cf6-fabb-41ed-a2c0-382cfdc7a011"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:19.542463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-a20802fe-7468-4e6b-bc13-2531ac2e9b5f req-4cfa2c41-a0d5-4c66-906f-38e44a47b080 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:19.543056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-a20802fe-7468-4e6b-bc13-2531ac2e9b5f req-4cfa2c41-a0d5-4c66-906f-38e44a47b080 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:19.562620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-a20802fe-7468-4e6b-bc13-2531ac2e9b5f req-4cfa2c41-a0d5-4c66-906f-38e44a47b080 service nova] Creating event network-changed:97934cf6-fabb-41ed-a2c0-382cfdc7a011 for instance fd30c63b-c274-43bd-8322-7f51a2d51166 on hv-cinder-83754 Jun 16 17:39:19.569518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-a20802fe-7468-4e6b-bc13-2531ac2e9b5f req-4cfa2c41-a0d5-4c66-906f-38e44a47b080 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051794 Jun 16 17:39:19.570737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 303/607] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:19.637384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:19.638270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:19.648229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:19.648705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:19.649577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:19.650184 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:19.996438 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:20.005281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:20.008272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:20.009837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-765ded56-132d-4b4d-8c74-ddab8b96c333 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.376609 Jun 16 17:39:20.011241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 305/608] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:19 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:20.347233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:20.348275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:20.357117 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:20.358361 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:20.360177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:20.361238 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:20.587792 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:20.598057 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a7ffd32b-6e53-453f-a8f6-979534aff42b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.255001 Jun 16 17:39:20.599128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 304/609] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:20 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:20.827584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-7da75169-cded-4404-97e1-74150b934c71 req-2053e784-30ed-4e30-8450-aaa8c39ae7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:20.837683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7da75169-cded-4404-97e1-74150b934c71 req-2053e784-30ed-4e30-8450-aaa8c39ae7ea service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:20.838341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7da75169-cded-4404-97e1-74150b934c71 req-2053e784-30ed-4e30-8450-aaa8c39ae7ea service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:20.856851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-7da75169-cded-4404-97e1-74150b934c71 req-2053e784-30ed-4e30-8450-aaa8c39ae7ea service nova] Creating event network-changed:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:39:20.861826 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-7da75169-cded-4404-97e1-74150b934c71 req-2053e784-30ed-4e30-8450-aaa8c39ae7ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 Jun 16 17:39:20.863013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 306/610] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:21.028474 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:21.029487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:21.036207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:21.037188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:21.038227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:21.038836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:21.306624 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:21.315494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:21.317018 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:21.318702 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-75d3dfcb-4e13-4f8d-9d9b-64a81b2b126d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.293570 Jun 16 17:39:21.319371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 305/611] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:21 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:21.617696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:21.619472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:21.637116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:21.637599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:21.638373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:21.638852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:21.790494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:21.797889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-39fa7bfa-5cbb-4e1a-a1db-8545817f963e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.186427 Jun 16 17:39:21.798457 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 307/612] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:21 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:21.998875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:21.999437 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:22.006703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.007844 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.008116 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.008560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.033892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4e13a6ea-577e-464a-9b31-6da8556086cb tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/ips" status: 200 len: 148 microversion: 2.1 time: 0.039064 Jun 16 17:39:22.034731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 306/613] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:39:21 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:22.336910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:22.337710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:22.346042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.346707 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.347775 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.348378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.493524 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:22.501386 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:22.502884 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:22.503966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0a512642-f9ad-487f-be0d-b3f42f541d7d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.171995 Jun 16 17:39:22.504520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 308/614] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:22 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:22.816087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:22.816699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:22.823438 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.823884 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.824650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:22.825085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:22.955878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:22.960291 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:22.965074 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-eafa2c0c-4322-4ab7-87d1-1a832c74f423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.152958 Jun 16 17:39:22.965715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 307/615] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:22 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:23.423690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e1a913-7821-43aa-a9d2-84303b78b24c"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:23.424823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:23.431630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.432072 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:23.432824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.433284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:23.528447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:23.529070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:23.536423 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.536948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:23.537983 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.538508 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:23.664993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:23.686186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:23.694366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6f86170c-800b-4e96-a7e5-f71cf028f797 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274382 Jun 16 17:39:23.695158 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 309/616] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:39:23 2022] POST /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:23.696642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:23.698292 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:23.699596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-920da755-3d8e-422d-b902-3ca116a51c02 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.181311 Jun 16 17:39:23.720356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 308/617] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:23 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:23.983868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:23.984566 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:23.991804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.992245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:23.993009 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:23.993477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:24.140424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:24.149328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6001991a-bc49-4ea5-b9cf-144d5179e226 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.170110 Jun 16 17:39:24.149918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 310/618] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:23 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:24.718180 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:24.718785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:24.726401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:24.726870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:24.727634 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:24.728069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:24.859608 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:24.868526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:24.870074 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:24.871184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-798b7c69-d5c8-46a9-948b-8a6e1bfbae9a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.156894 Jun 16 17:39:24.871745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 309/619] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:24 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:25.167169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:25.167787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:25.174068 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:25.174543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:25.175321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:25.175756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:25.320718 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:25.327517 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-48a8e73b-cbeb-4566-a887-5bd7d19c4394 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.164822 Jun 16 17:39:25.328193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 311/620] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:25 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:25.456657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-bf1d22c3-c06c-4744-9361-7140176c9ff9 req-562d9ee1-db2c-4949-b520-b24514d29a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd30c63b-c274-43bd-8322-7f51a2d51166", "name": "network-vif-plugged", "status": "completed", "tag": "97934cf6-fabb-41ed-a2c0-382cfdc7a011"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:25.466415 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-bf1d22c3-c06c-4744-9361-7140176c9ff9 req-562d9ee1-db2c-4949-b520-b24514d29a41 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:25.466710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-bf1d22c3-c06c-4744-9361-7140176c9ff9 req-562d9ee1-db2c-4949-b520-b24514d29a41 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:25.481999 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-bf1d22c3-c06c-4744-9361-7140176c9ff9 req-562d9ee1-db2c-4949-b520-b24514d29a41 service nova] Creating event network-vif-plugged:97934cf6-fabb-41ed-a2c0-382cfdc7a011 for instance fd30c63b-c274-43bd-8322-7f51a2d51166 on hv-cinder-83754 Jun 16 17:39:25.487567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-bf1d22c3-c06c-4744-9361-7140176c9ff9 req-562d9ee1-db2c-4949-b520-b24514d29a41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034281 Jun 16 17:39:25.488815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 310/621] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:25.889425 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:25.890033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:25.896755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:25.897867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:25.898760 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:25.899203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.036958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:26.041818 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:26.042372 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:26.046410 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:26.047918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:26.049025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1ebc5cb3-b92e-4444-85e6-481c0acd73e1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.163404 Jun 16 17:39:26.049199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.049515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.049639 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 312/622] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:25 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:26.050275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.050700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.139264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'services' on Instance uuid 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:26.219447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8bf25df3-f34a-4a9a-886e-52b4183eab11 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments/ebdb7ec7-6b91-48cb-ab8d-446875b70d23" status: 202 len: 0 microversion: 2.1 time: 0.181725 Jun 16 17:39:26.220042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 311/623] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:39:26 2022] DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments/ebdb7ec7-6b91-48cb-ab8d-446875b70d23 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:39:26.230283 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:26.231445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:26.237921 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.238367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.239131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.239567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.274075 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5ccb8b5b-605e-4ebf-af4d-7f415dc58d4e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049441 Jun 16 17:39:26.274743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 313/624] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:26 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:26.346607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:26.347312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:26.355314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.355765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.356537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:26.356973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:26.501820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:26.515563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8fb1d337-d2f4-4df6-8c0c-8e227c2eef1a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1363 microversion: 2.1 time: 0.172798 Jun 16 17:39:26.516633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 312/625] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:26 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:27.069527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:27.069527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:27.076252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.076691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.077478 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.077908 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.243038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:27.259669 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=10 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:27.268584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:27.281631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:27.287511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:27.296461 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:27.297324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ce7983e0-cde6-4ef7-ab01-8d7a2d30ddfa tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.223058 Jun 16 17:39:27.297324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 314/626] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:27 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:27.298043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:27.298043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:27.308807 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.313227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.313227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.313227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.372279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e62459b1-f91c-4d5f-bf35-5d88a53518f5 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089774 Jun 16 17:39:27.373390 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 313/627] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:27 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:27.508268 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-de767ab6-d3b3-449c-a1f1-a58492ec9118 req-0dc7a3f1-887f-4a26-a806-c74bf9637032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "name": "network-vif-plugged", "status": "completed", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:27.518772 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-de767ab6-d3b3-449c-a1f1-a58492ec9118 req-0dc7a3f1-887f-4a26-a806-c74bf9637032 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.519233 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-de767ab6-d3b3-449c-a1f1-a58492ec9118 req-0dc7a3f1-887f-4a26-a806-c74bf9637032 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.534163 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-de767ab6-d3b3-449c-a1f1-a58492ec9118 req-0dc7a3f1-887f-4a26-a806-c74bf9637032 service nova] Creating event network-vif-plugged:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:39:27.535179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:27.535657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:27.538266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=14 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:27.541921 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-de767ab6-d3b3-449c-a1f1-a58492ec9118 req-0dc7a3f1-887f-4a26-a806-c74bf9637032 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037704 Jun 16 17:39:27.542744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 315/628] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:27.545435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.546442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.546650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.547087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.763890 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:27.772733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c8f5a756-1820-48bd-b079-c7f9ab37a423 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1549 microversion: 2.1 time: 0.241601 Jun 16 17:39:27.773573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 314/629] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:27 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1549 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:27.800225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:27.801112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:27.810526 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.811317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.812271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:27.812708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:27.920795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f6bbedcb-39b3-4e49-8df2-a5bc6077595a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125967 Jun 16 17:39:27.921447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 316/630] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:39:27 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:28.308252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:28.308933 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:28.316324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:28.317285 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:28.318323 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:28.318666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:28.392550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:28.393557 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:28.403853 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:28.404306 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:28.405582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:28.406425 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:28.444476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-de118768-e418-4049-9c35-4fbc814eacc1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055921 Jun 16 17:39:28.449254 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 317/631] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:28 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:28.488793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:28.498005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:28.499531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:28.500637 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f0c5d69f-afad-4a1e-b9f0-0100716addf5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1406 microversion: 2.20 time: 0.197887 Jun 16 17:39:28.501216 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 315/632] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:28 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:39:29.291388 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-76104c49-0433-4f0f-94ef-18ddd2ff9e50 req-2af07317-393e-4f8c-8996-84df62d4111b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd30c63b-c274-43bd-8322-7f51a2d51166", "tag": "97934cf6-fabb-41ed-a2c0-382cfdc7a011"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:29.303623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-76104c49-0433-4f0f-94ef-18ddd2ff9e50 req-2af07317-393e-4f8c-8996-84df62d4111b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.303623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-76104c49-0433-4f0f-94ef-18ddd2ff9e50 req-2af07317-393e-4f8c-8996-84df62d4111b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.329808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-76104c49-0433-4f0f-94ef-18ddd2ff9e50 req-2af07317-393e-4f8c-8996-84df62d4111b service nova] Creating event network-changed:97934cf6-fabb-41ed-a2c0-382cfdc7a011 for instance fd30c63b-c274-43bd-8322-7f51a2d51166 on hv-cinder-83754 Jun 16 17:39:29.337626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-76104c49-0433-4f0f-94ef-18ddd2ff9e50 req-2af07317-393e-4f8c-8996-84df62d4111b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051090 Jun 16 17:39:29.338548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 318/633] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:29.457448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:29.458548 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:29.466709 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:29.469179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.469669 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.470459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.470889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.508489 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-98e99a75-38fa-440b-b91a-462392a9103b tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055974 Jun 16 17:39:29.509079 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 316/634] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:29 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:29.520338 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:29.521067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:29.530568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.531013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.531890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.532339 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.692970 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:29.702531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:29.704040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:29.705216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-986866ec-8577-4bcf-b658-593c610831ba tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1599 microversion: 2.20 time: 0.189072 Jun 16 17:39:29.705778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 319/635] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:39:29 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:39:29.724777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:29.726514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:29.733454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.733903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.734698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:29.735130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:29.863279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-97262a4f-537f-4950-a243-3682eef7a0ce tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142821 Jun 16 17:39:29.864686 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 317/636] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jun 16 17:39:29 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:39:30.520321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:30.521306 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:30.531551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:30.532437 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:30.533440 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:30.534061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:30.573311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bb3773cc-06ef-4ba4-b5ef-4774f6f858ea tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056903 Jun 16 17:39:30.574151 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 320/637] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:30 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:31.354124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-5fa9b276-c69a-44be-98ef-0e7f8cc92f88 req-dbf2b579-a69f-43ac-b012-7a836adc6c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:31.358185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e1a913-7821-43aa-a9d2-84303b78b24c"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:31.359277 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.366294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.366554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-5fa9b276-c69a-44be-98ef-0e7f8cc92f88 req-dbf2b579-a69f-43ac-b012-7a836adc6c10 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.367007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-5fa9b276-c69a-44be-98ef-0e7f8cc92f88 req-dbf2b579-a69f-43ac-b012-7a836adc6c10 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.367943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.368738 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.369217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.380121 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-5fa9b276-c69a-44be-98ef-0e7f8cc92f88 req-dbf2b579-a69f-43ac-b012-7a836adc6c10 service nova] Creating event network-changed:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:39:31.388152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-5fa9b276-c69a-44be-98ef-0e7f8cc92f88 req-dbf2b579-a69f-43ac-b012-7a836adc6c10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039550 Jun 16 17:39:31.393802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 318/638] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:31.464452 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: POST /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments HTTP/1.1 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 74 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:39:31.466375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {"volumeAttachment": {"volumeId": "89e1a913-7821-43aa-a9d2-84303b78b24c"}} Jun 16 17:39:31.468077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'server_id': 'a84a8707-8182-47fa-b359-249a10a44e48', 'body': {'volumeAttachment': {'volumeId': '89e1a913-7821-43aa-a9d2-84303b78b24c'}}} Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:31.469064 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:31.470383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 400 to user: Invalid volume: volume 89e1a913-7821-43aa-a9d2-84303b78b24c is already attached to instances: a84a8707-8182-47fa-b359-249a10a44e48 {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eab6a5eb-c5b4-41eb-8253-48de0848c5c1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114477 Jun 16 17:39:31.472011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 321/639] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:39:31 2022] POST /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:39:31.548190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:31.549600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.556251 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.557000 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.558065 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.558659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.586010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:31.586972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.599045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.600322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.602711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.603401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.641980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-26706209-7a58-462b-bfa7-08f72732a0f8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060651 Jun 16 17:39:31.643518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 322/640] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:31 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 17:39:31.676780 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lazy-loading 'services' on Instance uuid a84a8707-8182-47fa-b359-249a10a44e48 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:31.747097 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:31.748278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.752815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:31.758574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.759659 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.760572 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.761100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.770215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-40a5fb71-b0d7-46f4-bf48-8bccc56ac89e tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments/89e1a913-7821-43aa-a9d2-84303b78b24c" status: 202 len: 0 microversion: 2.1 time: 0.225895 Jun 16 17:39:31.771347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 319/641] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:39:31 2022] DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments/89e1a913-7821-43aa-a9d2-84303b78b24c => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:39:31.782612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:31.783640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.791683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.792532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.793612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.794264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.797453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:31.833345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-741608a8-9916-4059-97bf-d59d649926ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055662 Jun 16 17:39:31.838295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 320/642] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:31 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:31.936460 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-93085a02-037a-41b2-8860-459355d032c7 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 204 len: 0 microversion: 2.1 time: 0.193295 Jun 16 17:39:31.937706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 323/643] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:31 2022] DELETE /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:31.947177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:31.948074 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:31.954770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.955286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:31.956145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:31.956654 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:32.106140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:32.114471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7dd9db2c-7cc0-4041-938d-846cc9e11768 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1688 microversion: 2.1 time: 0.172519 Jun 16 17:39:32.117032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 321/644] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:31 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:32.846461 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:32.847502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:32.854585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:32.855036 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:32.855823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:32.856257 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:32.889025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-31c99613-c83b-4555-853a-4be0b4f81867 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Jun 16 17:39:32.889646 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 324/645] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:32 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:33.133096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:33.133681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:33.140367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:33.140813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:33.141641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:33.142069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:33.288672 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:33.296442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-36cb68fb-8b62-4680-84cd-ad46936bbcc8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1688 microversion: 2.1 time: 0.167400 Jun 16 17:39:33.297024 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 322/646] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:33 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:33.902466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:33.903397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:33.910223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:33.910675 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:33.911445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:33.911958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:33.939886 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:33.945360 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f55944d8-13f1-4d3c-a1f5-d8651804b30f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Jun 16 17:39:33.946088 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 325/647] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:33 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:34.314700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:34.315609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:34.322693 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:34.323132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:34.323917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:34.324346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:34.471751 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:34.480030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1bd85efb-e919-463c-ae99-6258b3ee7cf1 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1688 microversion: 2.1 time: 0.169181 Jun 16 17:39:34.480874 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 323/648] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:34 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:34.957476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:34.958460 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:34.967893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:34.968415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:34.969393 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:34.969827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:35.003552 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-24f8f7ee-5e92-4f87-b356-e9313e8aea9b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Jun 16 17:39:35.004273 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 326/649] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:34 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:35.498472 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:35.499081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:35.506588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:35.508096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:35.508898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:35.509366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:35.716274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:35.719791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:35.725670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d3e0bfbd-a624-44e9-a76b-aca8f011b42f tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1688 microversion: 2.1 time: 0.231150 Jun 16 17:39:35.726420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 324/650] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:35 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:36.018812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:36.020165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:36.028365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.028873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.029693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.031279 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.062547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5b1201fc-cc64-4ae6-b184-2cf8c2e95f6a tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049247 Jun 16 17:39:36.063139 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 327/651] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:39:36 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:39:36.128761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:36.129416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:36.137539 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.138067 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.138909 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.139418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.171068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:36.268898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0b1019ce-ccaa-41b2-892c-e1f73e69c47d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 204 len: 0 microversion: 2.1 time: 0.144282 Jun 16 17:39:36.269650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 325/652] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:36 2022] DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:36.282141 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:36.282761 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:36.289784 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.290237 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.291021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.291454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.530850 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:36.542238 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3ff31f2b-bd0a-456a-89fb-d3f549458fd2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1681 microversion: 2.1 time: 0.264538 Jun 16 17:39:36.542837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 328/653] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:36 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:36.705484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-739cacc2-13d8-4a5f-a458-b88a9c29a5e3 req-438f1b6b-2f76-4f1c-9ca4-9348aa6688ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c168b-5f64-4d47-ae45-8a006f09dfe1", "name": "network-vif-deleted", "tag": "bb6292bd-d4a4-4f49-ae28-32181d3a72ae"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:36.724586 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-739cacc2-13d8-4a5f-a458-b88a9c29a5e3 req-438f1b6b-2f76-4f1c-9ca4-9348aa6688ce service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.725866 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-739cacc2-13d8-4a5f-a458-b88a9c29a5e3 req-438f1b6b-2f76-4f1c-9ca4-9348aa6688ce service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.738270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-739cacc2-13d8-4a5f-a458-b88a9c29a5e3 req-438f1b6b-2f76-4f1c-9ca4-9348aa6688ce service nova] Creating event network-vif-deleted:bb6292bd-d4a4-4f49-ae28-32181d3a72ae for instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 on hv-cinder-83754 Jun 16 17:39:36.744454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:36.744712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-739cacc2-13d8-4a5f-a458-b88a9c29a5e3 req-438f1b6b-2f76-4f1c-9ca4-9348aa6688ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042871 Jun 16 17:39:36.745485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:36.748343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 326/654] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:36.753234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.753944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.754729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:36.755167 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:36.825211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:36.834735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d92de280-65a8-4e59-885a-021b04d659f9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1621 microversion: 2.1 time: 0.094637 Jun 16 17:39:36.844597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 329/655] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:36 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:37.560841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:37.561851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:37.568613 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:37.569060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:37.570225 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:37.570618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:37.715221 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:37.723061 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f81a929d-daf4-4881-a9f9-c8d80d036c3f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1681 microversion: 2.1 time: 0.167010 Jun 16 17:39:37.723981 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 327/656] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:37 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:37.853403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:37.853972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:37.864226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:37.864943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:37.867031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:37.867512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:37.903450 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:37.903905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:37.904355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'fault' on Instance uuid 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:37.951830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:37.962674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-26bb4220-3cab-41e6-b109-0b1774496444 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 200 len: 1335 microversion: 2.1 time: 0.114564 Jun 16 17:39:37.963270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 330/657] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:37 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:38.741712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:38.742349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:38.749522 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:38.749965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:38.750743 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:38.751174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:38.986042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:38.986955 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 2d1c168b-5f64-4d47-ae45-8a006f09dfe1] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:38.994453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:38.994902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:38.995686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:38.996124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:39.011787 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] HTTP exception thrown: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Request method failure captured: Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 HTTP/1.1 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mfxyiT9WKfMSFPJaojSJe8--KXr7L7nqmAZJmt-eZ_rxN89uFYZ0s6ZwdSHtzILeQt26Vf1ANnb3FFotcJOYeL-jRg_JylhkFBvmCZUCGzhTQzKL4EJm7iJTBTm1HJYlbP83QdnrK1lJ9Bib2x46YrqsGnqvZoLRiBixNANE2nYZ0 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:39:39.013825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1c1d13142434356ac1210f14dad847b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1c1d13142434356ac1210f14dad847b"}]}] Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: a5c37b79bf3d40f4a6182cc296585c18 Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. Jun 16 17:39:39.016798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '2d1c168b-5f64-4d47-ae45-8a006f09dfe1'} Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:39.022378 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. Jun 16 17:39:39.025272 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:39.029918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Returning 404 to user: Instance 2d1c168b-5f64-4d47-ae45-8a006f09dfe1 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:39.029918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1925f69c-2fcd-4243-b47e-bd193ba05393 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1" status: 404 len: 111 microversion: 2.1 time: 0.034195 Jun 16 17:39:39.029918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 331/658] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:38 2022] GET /compute/v2.1/servers/2d1c168b-5f64-4d47-ae45-8a006f09dfe1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:39.031513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0c42f81c-639d-446d-8ed6-168e2b896743 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '.version_select at 0x7f84aa290f70>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:39.054348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0c42f81c-639d-446d-8ed6-168e2b896743 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963321092" status: 202 len: 0 microversion: 2.1 time: 0.031358 Jun 16 17:39:39.059165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 332/659] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963321092 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:39:39.102459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:39.113532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5de82524-412e-4e93-89c4-1f6789b276b1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 200 len: 1613 microversion: 2.1 time: 0.375253 Jun 16 17:39:39.127534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 328/660] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:38 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 1613 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:39.330331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-1e868af1-94d8-4fc9-ad2d-67bb49f67669 req-bbf7c3ec-660a-4157-ab35-a6cdfeb1cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84a8707-8182-47fa-b359-249a10a44e48", "name": "network-vif-deleted", "tag": "5216b201-175c-4137-a731-eefb03a0fd37"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:39.341456 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1e868af1-94d8-4fc9-ad2d-67bb49f67669 req-bbf7c3ec-660a-4157-ab35-a6cdfeb1cc26 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:39.341996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1e868af1-94d8-4fc9-ad2d-67bb49f67669 req-bbf7c3ec-660a-4157-ab35-a6cdfeb1cc26 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:39.353527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-1e868af1-94d8-4fc9-ad2d-67bb49f67669 req-bbf7c3ec-660a-4157-ab35-a6cdfeb1cc26 service nova] Creating event network-vif-deleted:5216b201-175c-4137-a731-eefb03a0fd37 for instance a84a8707-8182-47fa-b359-249a10a44e48 on hv-cinder-83754 Jun 16 17:39:39.359185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-1e868af1-94d8-4fc9-ad2d-67bb49f67669 req-bbf7c3ec-660a-4157-ab35-a6cdfeb1cc26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033310 Jun 16 17:39:39.361095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 333/661] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:40.135164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:40.135911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:40.142351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:40.142802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:40.143790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:40.144408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:40.160189 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 HTTP/1.1 Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:39:40.162475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:39:40.165609 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'a84a8707-8182-47fa-b359-249a10a44e48'} Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:40.167026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:39:40.169734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:40.171770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:40.171770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-451fb90e-0f36-41e6-81e1-a443d065cd78 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 404 len: 111 microversion: 2.1 time: 0.033835 Jun 16 17:39:40.171770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 329/662] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:40 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:39:40.173811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c35eaa3e-33ab-414d-b01b-1cbc183490a7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '.version_select at 0x7f84aa7e2820>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:40.192837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c35eaa3e-33ab-414d-b01b-1cbc183490a7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240930818" status: 202 len: 0 microversion: 2.1 time: 0.023240 Jun 16 17:39:40.194529 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 334/663] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:39:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240930818 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:39:40.913451 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-47f55e77-9178-4436-8fdb-be87322dcf12 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: .version_select at 0x7f84aa394af0>, body: {"keypair": {"name": "tempest-keypair-1241393700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKKHfzTaLJSpHHqTaA0ORz2V8QhO/8/AK+aRyDjJnV9aetTAK4uuFBcxKDUpF1Ke1S/xHj+VEleTPQOEYGSCb2vlRILwub/Y8X7i8b5kGW3K6rqugzZ0F+I3n0+121Dgg=="}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:40.930788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-47f55e77-9178-4436-8fdb-be87322dcf12 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:40.935063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-47f55e77-9178-4436-8fdb-be87322dcf12 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'key_pairs'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:40.960924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-47f55e77-9178-4436-8fdb-be87322dcf12 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054588 Jun 16 17:39:40.961560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 330/664] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:39:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:42.217797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:42.218702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:42.227228 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:42.227697 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:42.228537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:42.228992 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:42.261263 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:42.362338 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f0144dab-e06a-4d29-88d1-e5d43776dc1e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 204 len: 0 microversion: 2.1 time: 0.148298 Jun 16 17:39:42.363156 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 335/665] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:42 2022] DELETE /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:39:42.372653 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:42.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:42.382640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:42.383098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:42.383912 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:42.384348 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:42.546543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:42.556056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f2e6e0ca-27ba-4173-a812-f21dc4e21580 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1508 microversion: 2.1 time: 0.187882 Jun 16 17:39:42.556641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 331/666] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:42 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:42.629289 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-542543783", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb674c9-6bb7-4c32-892c-b28837e89812"}], "security_groups": [{"name": "tempest-securitygroup--364270445"}], "key_name": "tempest-keypair-1241393700", "user_data": "}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:42.747287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] validate_networks() for [('6fb674c9-6bb7-4c32-892c-b28837e89812', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:39:43.228683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:39:43.232804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:39:43.233346 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:39:43.233770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:39:43.234185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:39:43.246455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:43.246938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:43.247749 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:43.248191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:43.266358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:39:43.270484 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Getting quotas for user 209ada6ba12b4bfda10045b4ee9301f1 and project d63c592c0afb4dfc9dd5b36be791decd. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:39:43.289340 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:39:43.291734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:39:43.342361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a8c056a3-20c1-459c-9274-872f16fe68f8 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719895 Jun 16 17:39:43.343115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 336/667] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:39:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:39:43.356051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3800c193-0b3c-4505-8cf1-d9eb3438cd32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:43.356857 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3800c193-0b3c-4505-8cf1-d9eb3438cd32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:43.416823 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3800c193-0b3c-4505-8cf1-d9eb3438cd32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:43.425483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3800c193-0b3c-4505-8cf1-d9eb3438cd32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1241 microversion: 2.1 time: 0.075810 Jun 16 17:39:43.426519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 332/668] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:43 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:43.582192 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:43.584304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:43.592136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:43.592625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:43.593446 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:43.593915 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:43.752744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:43.764993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-756d3bf6-afbb-4edb-9a8b-090a8dfda38a tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1508 microversion: 2.1 time: 0.190089 Jun 16 17:39:43.765628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 337/669] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:43 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:44.444401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:44.445571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:44.452008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:44.452442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:44.453269 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:44.453742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:44.537237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:44.548750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2707d57e-d85a-4bf7-8aaa-7855c7dca154 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1245 microversion: 2.1 time: 0.109027 Jun 16 17:39:44.549812 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 333/670] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:44 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:44.787686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:44.788876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:44.795562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:44.796031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:44.796805 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:44.797278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:44.999137 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:45.009648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-adab7595-4fa4-49a4-84e6-74ddc665cc24 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1508 microversion: 2.1 time: 0.226354 Jun 16 17:39:45.010417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 338/671] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:44 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:45.570008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:45.571407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:45.578994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:45.579972 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:45.581708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:45.583098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:45.675522 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-1b34d357-1557-4e98-938b-964f88db512c req-65b84b7a-d65c-4cec-9983-30c2141be236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fe7037-080f-4209-bdc6-c505c4c34ec3", "name": "network-vif-deleted", "tag": "62e3038f-b183-4ed1-bedd-da99fe182bf8"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:45.691115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1b34d357-1557-4e98-938b-964f88db512c req-65b84b7a-d65c-4cec-9983-30c2141be236 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:45.695572 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-1b34d357-1557-4e98-938b-964f88db512c req-65b84b7a-d65c-4cec-9983-30c2141be236 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:45.708866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-1b34d357-1557-4e98-938b-964f88db512c req-65b84b7a-d65c-4cec-9983-30c2141be236 service nova] Creating event network-vif-deleted:62e3038f-b183-4ed1-bedd-da99fe182bf8 for instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 on hv-cinder-83754 Jun 16 17:39:45.714408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-1b34d357-1557-4e98-938b-964f88db512c req-65b84b7a-d65c-4cec-9983-30c2141be236 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045213 Jun 16 17:39:45.715858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 339/672] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:45.721753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:45.735390 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0a3cf1c0-480a-487f-8b79-5a9652964447 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1299 microversion: 2.1 time: 0.171108 Jun 16 17:39:45.736625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 334/673] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:45 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:46.030843 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:46.032117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:46.040858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:46.041591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:46.042855 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:46.043498 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:46.084857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:46.085607 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:46.086354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'fault' on Instance uuid 54fe7037-080f-4209-bdc6-c505c4c34ec3 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:46.147287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:46.156937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3cb19ad1-db4a-4809-b28b-984dda87103e tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 200 len: 1312 microversion: 2.1 time: 0.131264 Jun 16 17:39:46.166595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 340/674] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:46 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:46.755966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:46.757716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:46.765848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:46.766297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:46.767088 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:46.767518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:46.921177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:46.930133 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c04224b1-acb3-42b5-bc92-baace4445a55 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.179754 Jun 16 17:39:46.930734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 335/675] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:46 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:47.185958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:47.186910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: 54fe7037-080f-4209-bdc6-c505c4c34ec3] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:47.195281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.195808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.196716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.197290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.212486 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] HTTP exception thrown: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Request method failure captured: Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 HTTP/1.1 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mfxyiT9WKfMSFPJaojSJe8--KXr7L7nqmAZJmt-eZ_rxN89uFYZ0s6ZwdSHtzILeQt26Vf1ANnb3FFotcJOYeL-jRg_JylhkFBvmCZUCGzhTQzKL4EJm7iJTBTm1HJYlbP83QdnrK1lJ9Bib2x46YrqsGnqvZoLRiBixNANE2nYZ0 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:39:47.214314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1c1d13142434356ac1210f14dad847b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1c1d13142434356ac1210f14dad847b"}]}] Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: a5c37b79bf3d40f4a6182cc296585c18 Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. Jun 16 17:39:47.215943 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '54fe7037-080f-4209-bdc6-c505c4c34ec3'} Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:47.216861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. Jun 16 17:39:47.218367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:47.220370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Returning 404 to user: Instance 54fe7037-080f-4209-bdc6-c505c4c34ec3 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:47.220370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-876d9076-9e4a-4b30-b529-2dea9872c3d3 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3" status: 404 len: 111 microversion: 2.1 time: 0.035626 Jun 16 17:39:47.220370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 341/676] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:47 2022] GET /compute/v2.1/servers/54fe7037-080f-4209-bdc6-c505c4c34ec3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:47.246619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:47.247734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:47.261086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.262211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.263567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.264796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.309364 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:47.397994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-f97badef-5870-4932-85d3-02931444c877 req-b54e8b20-0f25-41fd-9014-56c09cb3322b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9739d117-bf76-4ac4-b172-1ec63768027d", "tag": "c4cf8f46-c85c-4601-8250-462de6025ebf"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:47.407381 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-f97badef-5870-4932-85d3-02931444c877 req-b54e8b20-0f25-41fd-9014-56c09cb3322b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.408198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-f97badef-5870-4932-85d3-02931444c877 req-b54e8b20-0f25-41fd-9014-56c09cb3322b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.424859 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-f97badef-5870-4932-85d3-02931444c877 req-b54e8b20-0f25-41fd-9014-56c09cb3322b service nova] Creating event network-changed:c4cf8f46-c85c-4601-8250-462de6025ebf for instance 9739d117-bf76-4ac4-b172-1ec63768027d on hv-cinder-83754 Jun 16 17:39:47.432332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-f97badef-5870-4932-85d3-02931444c877 req-b54e8b20-0f25-41fd-9014-56c09cb3322b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163240 Jun 16 17:39:47.433774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 342/677] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:47.451979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-216bf022-c6ce-420a-a3ac-7df1a0a84ac8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 204 len: 0 microversion: 2.1 time: 0.227466 Jun 16 17:39:47.454195 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 336/678] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:47 2022] DELETE /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:47.465050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:47.465792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:47.472595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.473362 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.474295 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.476589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.618892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:47.627867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5c13216b-f54f-45bd-a57c-2dfca0b4cfd9 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.167034 Jun 16 17:39:47.628720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 343/679] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:47 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:47.950088 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:47.950803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:47.958723 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.959421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:47.960341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:47.960886 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:48.107605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:48.115347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-005c55b3-95f6-4d35-a2b9-9d63225f66e7 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.170975 Jun 16 17:39:48.115913 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 337/680] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:47 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:48.648444 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:48.649138 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:48.655817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:48.656271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:48.657040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:48.657505 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:48.802617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:48.810918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-aa3b5495-ec6f-409a-9bd1-b92697fc5a7d tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.166903 Jun 16 17:39:48.811502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 344/681] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:48 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:49.133357 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:49.133979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:49.140775 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:49.141256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:49.142031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:49.142464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:49.325459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:49.333213 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7f0cbd65-3c0c-404a-8520-b05d31258cd9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.204408 Jun 16 17:39:49.333789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 338/682] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:49 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:49.833927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:49.834613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:49.841345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:49.841799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:49.842568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:49.843007 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:49.980323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:49.988038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f81a92f1-375d-4690-aa55-614764f4e399 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.158068 Jun 16 17:39:49.988597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 345/683] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:49 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:50.350647 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:50.351278 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:50.359058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:50.359495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:50.360434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:50.360873 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:50.503601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:50.512134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8a71f859-67cd-4869-90f3-f64086c25fa2 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.166554 Jun 16 17:39:50.513041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 339/684] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:50 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:51.006476 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:51.007191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:51.013984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:51.014433 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:51.015244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:51.015674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:51.019906 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:51.234250 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:51.243213 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8a6c19b2-fcb1-496a-a5c7-cc34ae997388 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1520 microversion: 2.1 time: 0.241363 Jun 16 17:39:51.243812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 346/685] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:51 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:51.491381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-ca1d6486-bd4b-4752-9f95-73d963df122d req-7051f610-5179-429f-8034-4ddf77af649a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69", "name": "network-vif-deleted", "tag": "86749e9f-ddc9-40e0-90f0-7a85e2519bf8"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:51.499793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ca1d6486-bd4b-4752-9f95-73d963df122d req-7051f610-5179-429f-8034-4ddf77af649a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:51.500232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ca1d6486-bd4b-4752-9f95-73d963df122d req-7051f610-5179-429f-8034-4ddf77af649a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:51.511777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-ca1d6486-bd4b-4752-9f95-73d963df122d req-7051f610-5179-429f-8034-4ddf77af649a service nova] Creating event network-vif-deleted:86749e9f-ddc9-40e0-90f0-7a85e2519bf8 for instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 on hv-cinder-83754 Jun 16 17:39:51.516521 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-ca1d6486-bd4b-4752-9f95-73d963df122d req-7051f610-5179-429f-8034-4ddf77af649a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094366 Jun 16 17:39:51.517105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 340/686] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:51.529906 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:51.530623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:51.536684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:51.537698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:51.538560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:51.538995 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:51.689585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:51.698753 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8a8a7b59-0e89-4322-835e-45934e0e4966 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.172761 Jun 16 17:39:51.703512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 347/687] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:51 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:52.264060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:52.264755 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:52.273475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:52.274084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:52.274882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:52.275339 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:52.313797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:52.314706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:52.315479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lazy-loading 'fault' on Instance uuid b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:52.375875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5c37b79bf3d40f4a6182cc296585c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c1d13142434356ac1210f14dad847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:52.380402 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:52.387938 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a39e63c9-13ea-485a-941c-307bc69a74e8 tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 200 len: 1311 microversion: 2.1 time: 0.128623 Jun 16 17:39:52.388899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 341/688] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:52 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:52.717232 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:52.717887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:52.724503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:52.725558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:52.726508 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:52.726947 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:52.869491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:52.877691 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b0fdb5dc-8c08-4d31-8239-7f4e640f0e56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.164442 Jun 16 17:39:52.878260 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 348/689] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:52 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:53.408721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:53.409584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] [instance: b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:53.419071 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:53.419699 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:53.420534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:53.420973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:53.421819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=6 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:53.440706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] HTTP exception thrown: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Request method failure captured: Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 HTTP/1.1 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mfxyiT9WKfMSFPJaojSJe8--KXr7L7nqmAZJmt-eZ_rxN89uFYZ0s6ZwdSHtzILeQt26Vf1ANnb3FFotcJOYeL-jRg_JylhkFBvmCZUCGzhTQzKL4EJm7iJTBTm1HJYlbP83QdnrK1lJ9Bib2x46YrqsGnqvZoLRiBixNANE2nYZ0 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:39:53.442453 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1c1d13142434356ac1210f14dad847b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1c1d13142434356ac1210f14dad847b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1c1d13142434356ac1210f14dad847b"}]}] Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d1c1d13142434356ac1210f14dad847b Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1537959647 Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: a5c37b79bf3d40f4a6182cc296585c18 Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1537959647-project Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. Jun 16 17:39:53.444134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69'} Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:53.445286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. Jun 16 17:39:53.447385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:39:53.449270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] Returning 404 to user: Instance b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:53.449270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e479fd9b-d6c8-468d-926f-c41b6c0cf1ed tempest-ServerRescueNegativeTestJSON-1537959647 tempest-ServerRescueNegativeTestJSON-1537959647-project] 10.222.0.40 "GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69" status: 404 len: 111 microversion: 2.1 time: 0.041007 Jun 16 17:39:53.449270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 342/690] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:53 2022] GET /compute/v2.1/servers/b4904f6d-1ce2-4af1-9fc3-f5ea5aa89e69 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:53.894463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:53.895105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:53.900080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:53.901164 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=6 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:53.906076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:53.906624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:53.907531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:53.908054 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:54.151514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:54.159704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-74ef7005-a5e6-4bef-bbf0-751382f2d378 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.269195 Jun 16 17:39:54.160432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 349/691] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:53 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:54.279974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:54.280551 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:54.289429 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:54.290008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:54.291029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:54.291661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:54.318741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:39:54.403209 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-68c5dc04-b445-42ce-b259-39a700a1c633 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 204 len: 0 microversion: 2.1 time: 0.132683 Jun 16 17:39:54.407502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 343/692] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:39:54 2022] DELETE /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:39:54.415177 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:54.416020 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:54.422935 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:54.423381 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:54.424216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:54.424651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:54.670912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:54.680006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1d96544e-22a4-4c5c-a678-5e9f1d31b711 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1575 microversion: 2.1 time: 0.271173 Jun 16 17:39:54.680589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 350/693] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:54 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:55.179589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:55.180312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:55.187671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:55.188131 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:55.188919 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:55.189466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:55.456827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-dd7ed6d5-03c4-4bef-b3e2-52cb29ce54cd req-1316202c-e915-470c-897f-166680a0b7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9739d117-bf76-4ac4-b172-1ec63768027d", "name": "network-vif-plugged", "status": "completed", "tag": "c4cf8f46-c85c-4601-8250-462de6025ebf"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:55.470067 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:55.477695 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-dd7ed6d5-03c4-4bef-b3e2-52cb29ce54cd req-1316202c-e915-470c-897f-166680a0b7f4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:55.478535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-dd7ed6d5-03c4-4bef-b3e2-52cb29ce54cd req-1316202c-e915-470c-897f-166680a0b7f4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:55.480573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e1585b2a-ea48-4141-b7db-cc8680da9931 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.306278 Jun 16 17:39:55.481486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 344/694] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:55 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:55.496203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-dd7ed6d5-03c4-4bef-b3e2-52cb29ce54cd req-1316202c-e915-470c-897f-166680a0b7f4 service nova] Creating event network-vif-plugged:c4cf8f46-c85c-4601-8250-462de6025ebf for instance 9739d117-bf76-4ac4-b172-1ec63768027d on hv-cinder-83754 Jun 16 17:39:55.502316 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-dd7ed6d5-03c4-4bef-b3e2-52cb29ce54cd req-1316202c-e915-470c-897f-166680a0b7f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050414 Jun 16 17:39:55.502990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 351/695] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:55.703001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:55.703628 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:55.710973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:55.711787 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:55.712757 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:55.713383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:56.023481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:56.034715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b4d89b05-9523-4ab4-a63c-560cf40820bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1575 microversion: 2.1 time: 0.340001 Jun 16 17:39:56.049160 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 345/696] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:55 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1575 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:56.505225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:56.509090 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:56.519216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:56.519836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:56.521132 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:56.521916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:56.813072 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:56.863808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d37b6ed4-b1a0-4c28-8af4-e5e86eec88fa tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1366 microversion: 2.1 time: 0.366932 Jun 16 17:39:56.864561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 352/697] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:56 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:57.058363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:57.059479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:57.071756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:57.072583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:57.074154 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:57.075068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:57.230721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:57.245345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-32d5cc2a-3288-4cd9-a0c4-0fd2175d21c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1508 microversion: 2.1 time: 0.193123 Jun 16 17:39:57.257855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 346/698] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:57 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:57.342246 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-b04fc83b-ff29-4ce3-a80d-a45fae7c26e3 req-f5371a13-6c76-46b1-a80f-955d65154815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d39f223-c8ed-4c3c-a006-fe3698711485", "name": "network-vif-deleted", "tag": "161d75cc-2de3-4882-81a1-afdc5ee23ee9"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:57.351321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b04fc83b-ff29-4ce3-a80d-a45fae7c26e3 req-f5371a13-6c76-46b1-a80f-955d65154815 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:57.351776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b04fc83b-ff29-4ce3-a80d-a45fae7c26e3 req-f5371a13-6c76-46b1-a80f-955d65154815 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:57.364138 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-b04fc83b-ff29-4ce3-a80d-a45fae7c26e3 req-f5371a13-6c76-46b1-a80f-955d65154815 service nova] Creating event network-vif-deleted:161d75cc-2de3-4882-81a1-afdc5ee23ee9 for instance 8d39f223-c8ed-4c3c-a006-fe3698711485 on hv-cinder-83754 Jun 16 17:39:57.374280 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-b04fc83b-ff29-4ce3-a80d-a45fae7c26e3 req-f5371a13-6c76-46b1-a80f-955d65154815 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035902 Jun 16 17:39:57.374907 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 353/699] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:39:57.891196 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:57.891808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:57.900613 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:57.901057 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:57.901864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:57.902846 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.149715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:58.159066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4ef1552f-33ad-4e6a-9d00-c6caf8c39ff9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1555 microversion: 2.1 time: 0.272779 Jun 16 17:39:58.171817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 347/700] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:57 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:39:58.186569 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:58.190080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:58.199861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:58.200312 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.201352 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:58.201796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.263782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:58.264510 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:58.270957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:58.275072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.278369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:58.280988 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.302984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ddb72fbc-fea8-4ccd-b60e-9ccc8e80fd47 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129961 Jun 16 17:39:58.304235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 354/701] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jun 16 17:39:58 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:39:58.345224 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:58.345840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:58.346556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lazy-loading 'fault' on Instance uuid 8d39f223-c8ed-4c3c-a006-fe3698711485 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:39:58.419955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:39:58.431075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c5ae9493-9a49-429e-8770-9c9aa05f02c9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 200 len: 1229 microversion: 2.1 time: 0.171184 Jun 16 17:39:58.432378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 348/702] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:58 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:39:59.452772 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:39:59.454165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:39:59.468175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:59.470077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:59.470797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:59.471798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:39:59.472343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:39:59.497822 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] HTTP exception thrown: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Request method failure captured: Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 HTTP/1.1 Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2oksHa67tve_fkb2iUG37eFBFJ18UlQslPqeTUfBskRS-e9p8WKN_vE2XSl0-Z3HkrC52eAV8_FUOCKzqAI25K5Ip-lQvLIC4cQ5EWO61JHochP3da5iACLfKbfc_MQxXQ89rTkpqtqHtkug4PM-cN0Ety-j3DRpd9aM2EXjeQij0w Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:39:59.500752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_314e9434e0ec4c1f9e8d6037143f5ebb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/314e9434e0ec4c1f9e8d6037143f5ebb"}]}] Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: faf0a0102da24cedaedd0c67273e275b Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:39:59.502424 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '8d39f223-c8ed-4c3c-a006-fe3698711485'} Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:39:59.503350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:39:59.504634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:39:59.506616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Returning 404 to user: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:39:59.506616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bee59046-110f-47e1-ae5c-e74681d17aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 404 len: 111 microversion: 2.1 time: 0.055593 Jun 16 17:39:59.515144 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 355/703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:39:59 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:39:59.631086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-642885854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489756062", "security_groups": [{"name": "tempest-secgroup-smoke-266615842"}], "block_device_mapping_v2": [{"uuid": "bf2354da-94ce-4334-a28c-53996789c8df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6e803cc9-885b-4092-b21c-ed0c8b49c26c"}]}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:39:59.648335 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:39:59.797033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] validate_networks() for [('6e803cc9-885b-4092-b21c-ed0c8b49c26c', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:40:00.066411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-b86dacc6-eca3-4895-9885-5c3ca6b9fbeb req-a8a81c59-e1d6-49f3-8cb6-8c997f6f556a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9739d117-bf76-4ac4-b172-1ec63768027d", "tag": "c4cf8f46-c85c-4601-8250-462de6025ebf"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:00.078149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b86dacc6-eca3-4895-9885-5c3ca6b9fbeb req-a8a81c59-e1d6-49f3-8cb6-8c997f6f556a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:00.078803 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b86dacc6-eca3-4895-9885-5c3ca6b9fbeb req-a8a81c59-e1d6-49f3-8cb6-8c997f6f556a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:00.100534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-b86dacc6-eca3-4895-9885-5c3ca6b9fbeb req-a8a81c59-e1d6-49f3-8cb6-8c997f6f556a service nova] Creating event network-changed:c4cf8f46-c85c-4601-8250-462de6025ebf for instance 9739d117-bf76-4ac4-b172-1ec63768027d on hv-cinder-83754 Jun 16 17:40:00.111432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-b86dacc6-eca3-4895-9885-5c3ca6b9fbeb req-a8a81c59-e1d6-49f3-8cb6-8c997f6f556a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049053 Jun 16 17:40:00.113200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 356/704] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:00.585660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:40:00.586097 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:40:00.586562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:40:00.586968 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:40:00.587371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:40:00.601171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:00.601775 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:00.602594 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:00.603169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:00.623253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:40:00.627768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for user faf0a0102da24cedaedd0c67273e275b and project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:40:00.722318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:40:00.727408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf2354da-94ce-4334-a28c-53996789c8df',volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:40:00.923427 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e2c66bf0-c631-481f-ab13-2b14f8b4453a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296843 Jun 16 17:40:00.924081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 349/705] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:39:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:40:00.949124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a60f9732-acf9-4084-ae57-71e9f0d401d2 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:00.949858 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a60f9732-acf9-4084-ae57-71e9f0d401d2 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:01.030973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a60f9732-acf9-4084-ae57-71e9f0d401d2 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:01.043522 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a60f9732-acf9-4084-ae57-71e9f0d401d2 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1093 microversion: 2.1 time: 0.111847 Jun 16 17:40:01.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 357/706] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:00 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:01.145646 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:01.147485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:01.158823 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:01.160440 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:01.165698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:01.166589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:01.223767 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lazy-loading 'flavor' on Instance uuid bf54c7b6-dc97-4196-bab4-a7698f785a20 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:40:01.391747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6f96bdb0-e3df-46d6-9861-88bc8e99fe56 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "POST /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20/action" status: 202 len: 0 microversion: 2.1 time: 0.254447 Jun 16 17:40:01.397526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 350/707] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:40:01 2022] POST /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:40:01.404909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:01.406049 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:01.419309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:01.420086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:01.426455 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:01.428161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:01.622815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:01.642580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-103f4df5-e9c4-4d68-8512-38b830066921 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.244055 Jun 16 17:40:01.643513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 358/708] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:01 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:02.063260 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:02.064270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:02.071697 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:02.072164 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:02.072965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:02.073434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:02.151802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:02.161096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7a6294df-0d1e-4225-8274-bfd941a28cc4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1191 microversion: 2.1 time: 0.102325 Jun 16 17:40:02.162324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 351/709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:02 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:02.673065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:02.674807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:02.686029 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:02.687135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:02.688416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:02.689070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:02.892876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:02.905750 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-36f986d1-9059-4334-928c-0c41494cb97d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.236655 Jun 16 17:40:02.906935 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 359/710] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:02 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:03.183463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:03.184638 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:03.197210 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:03.198045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:03.199477 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:03.200581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:03.379999 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:03.390031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-011e25d1-d3a0-42e7-a9ed-abf66e2137a4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.213393 Jun 16 17:40:03.390612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 352/711] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:03 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:03.875510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-9994354d-5c0f-4b3f-8cda-f9a0c9325272 req-d6f13b0e-f4ee-4428-8490-1669c68d768f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e064158b-7b81-42c1-bc01-057812cdcb57", "tag": "cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:03.888920 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9994354d-5c0f-4b3f-8cda-f9a0c9325272 req-d6f13b0e-f4ee-4428-8490-1669c68d768f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:03.889703 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9994354d-5c0f-4b3f-8cda-f9a0c9325272 req-d6f13b0e-f4ee-4428-8490-1669c68d768f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:03.917598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-9994354d-5c0f-4b3f-8cda-f9a0c9325272 req-d6f13b0e-f4ee-4428-8490-1669c68d768f service nova] Creating event network-changed:cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e for instance e064158b-7b81-42c1-bc01-057812cdcb57 on hv-cinder-83754 Jun 16 17:40:03.928870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:03.929814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:03.931091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-9994354d-5c0f-4b3f-8cda-f9a0c9325272 req-d6f13b0e-f4ee-4428-8490-1669c68d768f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059353 Jun 16 17:40:03.932116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 360/712] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:03.945015 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:03.945511 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:03.946324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:03.946768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:04.171507 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:04.182300 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c44a6fa2-6e73-43df-8bbc-3655653d6cb9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.257868 Jun 16 17:40:04.194520 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 353/713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:03 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:04.410116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:04.411065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:04.419249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:04.420219 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:04.421213 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:04.421852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:04.625527 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:04.628366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-dbf5e44f-a51c-47d6-bfed-027be82f52c5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.224268 Jun 16 17:40:04.628939 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 361/714] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:04 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:05.203515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:05.204134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:05.211493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:05.211934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:05.212704 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:05.213127 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:05.374977 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:05.385034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6ccd270d-a610-460c-9dfc-56b96575072f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.185180 Jun 16 17:40:05.385682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 354/715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:05 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:05.647594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:05.648568 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:05.654867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:05.655324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:05.658361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:05.658361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:05.793059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:05.800743 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1a528bdd-55de-4feb-9ce0-6adae2b182c8 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.157968 Jun 16 17:40:05.801349 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 362/716] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:05 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:06.404120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:06.404673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:06.411218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:06.412363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:06.413144 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:06.413639 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:06.556992 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:06.560551 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:06.565621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f2d60a0c-faa5-48ea-8761-67eb2fd2359b tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.165389 Jun 16 17:40:06.566227 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 355/717] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:06 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:06.817783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:06.819329 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:06.826328 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:06.826775 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:06.827563 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:06.828000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:06.970611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:06.980395 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-911747f7-c54f-432d-8fd7-caf176cc7bac tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.166561 Jun 16 17:40:06.980990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 363/718] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:06 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:07.588612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:07.589220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:07.597010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:07.597399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:07.598162 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:07.598603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:07.771220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:07.779741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9e481809-1237-4e96-ace3-50835be232df tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.195716 Jun 16 17:40:07.780337 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 356/719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:07 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:07.998633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:07.999326 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:08.007170 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:08.007705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:08.008747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:08.009361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:08.198489 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:08.206769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a844c2ba-5563-40bd-b782-1f42bd488aa9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.212163 Jun 16 17:40:08.207564 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 364/720] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:07 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:08.799216 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:08.799838 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:08.806731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:08.807177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:08.807946 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:08.808378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:08.965075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:08.973130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-78d288e0-149a-410d-be2c-d2df16596b2a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.178205 Jun 16 17:40:08.974393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 357/721] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:08 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:09.226237 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:09.226799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:09.233657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:09.234106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:09.234886 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:09.235660 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:09.395867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:09.405402 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-92140a7e-2685-4bd6-87f4-a5a3e2c43981 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.184744 Jun 16 17:40:09.405975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 365/722] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:09 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:09.992314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:09.992923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:09.999383 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:09.999836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:10.000603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:10.001033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:10.148706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:10.164585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2ee6cb87-90dc-47b5-a6bf-4a0fa5a877d6 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.176240 Jun 16 17:40:10.165813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 358/723] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:09 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:10.422658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:10.423581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:10.432376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:10.432831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:10.433653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:10.434100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:10.586502 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:10.595365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fdef2b8b-c786-4f87-b84f-e54ffd44f84d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.176717 Jun 16 17:40:10.595953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 366/724] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:10 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:11.192007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:11.197568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:11.197568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:11.197568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=6 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:11.204586 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:11.205038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:11.205858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:11.206300 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:11.393263 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:11.401516 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cd9e6968-1154-4f24-a602-853c0ad75f6c tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.213362 Jun 16 17:40:11.402343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 359/725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:11 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:11.614285 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:11.614827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:11.617371 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:11.623240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:11.623688 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:11.624457 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:11.624900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:11.648220 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:11.791276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:11.801594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-35f95140-27c7-4bdc-a905-7602fb88050e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.189716 Jun 16 17:40:11.801594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 367/726] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:11 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:12.419889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:12.420513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:12.426851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:12.427318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:12.428526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:12.428526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:12.575417 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:12.584029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f997c119-8cec-4a61-ba09-cef3498e3dc9 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.167904 Jun 16 17:40:12.584710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 360/727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:12 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:12.815848 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:12.816624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:12.825937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:12.826638 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:12.827584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:12.828215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:12.990483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:12.998655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-81ae92c1-4f63-4666-bbb4-3c1d3637a966 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.186656 Jun 16 17:40:12.999241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 368/728] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:12 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:13.452834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:13.454069 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:13.460966 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:13.461433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:13.462377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:13.462805 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:13.490960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7a3097a3-a9e3-4f87-9081-23ed1c0fa741 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/ips" status: 200 len: 145 microversion: 2.1 time: 0.237434 Jun 16 17:40:13.491540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 361/729] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:40:13 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/ips => generated 145 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:13.603937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:13.605160 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:13.611764 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:13.612510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:13.613330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:13.613836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:13.788852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:13.807875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4f7f2cf9-f840-4052-8e22-a19f7fb74ebb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.209638 Jun 16 17:40:13.814895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 369/730] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:13 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:14.016268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:14.017113 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:14.024720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.025550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.026043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.026497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.189360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:14.198564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-52c0ebc8-5d0b-4843-a206-1ef835b0c4bf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.186392 Jun 16 17:40:14.199225 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 362/731] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:14 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:14.837940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:14.838839 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:14.848511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.849366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.850581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.851248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.855762 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:14.856290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:14.866553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.867290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.869341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.870240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.907692 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d371387a-5860-4d3b-b047-19a56985e579 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/ips" status: 200 len: 153 microversion: 2.20 time: 0.056812 Jun 16 17:40:14.908763 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 363/732] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jun 16 17:40:14 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/ips => generated 153 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:40:14.916459 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5af6ea86-41fe-47d9-91d2-15e08fe261b5"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:14.918009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:14.927935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.928665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:14.930722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:14.931371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:15.064895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:15.074694 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-56d4b204-4e26-48a9-9e50-8dca1a5da352 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.246337 Jun 16 17:40:15.075830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 370/733] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:14 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:15.216994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:15.217814 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:15.228472 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:15.231057 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:15.232281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:15.233217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:15.529124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:15.538999 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-072719ec-4208-491f-99d6-b29717d093e1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.326909 Jun 16 17:40:15.540210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 371/734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:15 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:15.600247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-07df9519-5055-4f80-bc03-f277c3be392e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689438 Jun 16 17:40:15.601430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 364/735] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:40:14 2022] POST /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:16.099927 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:16.101334 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:16.109650 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.110443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.111813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.113132 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.287186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:16.295086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9becc802-f54c-49ce-b5b6-f36634356214 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1510 microversion: 2.1 time: 0.202839 Jun 16 17:40:16.306415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 372/736] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:16 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:16.317084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:16.319502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:16.326657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.327283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.328182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.328879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.420680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-547c5351-716d-4610-b6a3-9672880032f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "POST /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20/action" status: 202 len: 0 microversion: 2.1 time: 0.109236 Jun 16 17:40:16.421718 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 365/737] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:40:16 2022] POST /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:40:16.435655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:16.436398 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:16.446573 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.447115 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.447994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.448671 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.556662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:16.557314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:16.563720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.564274 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.565075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.565510 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.766022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:16.778200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-487d9801-7b90-4f94-bca3-48beb89d6be8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1518 microversion: 2.1 time: 0.352315 Jun 16 17:40:16.782324 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 373/738] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:16 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:16.807048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:16.817581 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a65a5a80-da2f-4ab1-8574-0652ebce0094 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.264134 Jun 16 17:40:16.827418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 366/739] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:16 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:16.883391 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:16.883937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:16.896357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.897327 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.898456 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:16.899085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:16.935489 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lazy-loading 'flavor' on Instance uuid 9e3be83a-9759-422f-9cd1-5a5d1c631ace {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:40:17.227007 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9b401a13-5bc8-43de-b050-a7a07454f825 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/action" status: 202 len: 0 microversion: 2.20 time: 0.348779 Jun 16 17:40:17.233008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 374/740] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 17:40:16 2022] POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:40:17.238262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:17.240542 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:17.249118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.249669 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.250518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.251063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.402766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:17.412447 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:17.413994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:17.415388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c97f6b65-968d-4bec-99aa-9dcc981233ae tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.183322 Jun 16 17:40:17.415948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 367/741] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:17 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:17.724374 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-9e24e42e-89a0-4dd8-a7ff-36c207fc903c req-ac982ad6-2fbc-4b6b-979f-f34652582535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e064158b-7b81-42c1-bc01-057812cdcb57", "name": "network-vif-plugged", "status": "completed", "tag": "cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:17.743594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9e24e42e-89a0-4dd8-a7ff-36c207fc903c req-ac982ad6-2fbc-4b6b-979f-f34652582535 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.744705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-9e24e42e-89a0-4dd8-a7ff-36c207fc903c req-ac982ad6-2fbc-4b6b-979f-f34652582535 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.772167 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-9e24e42e-89a0-4dd8-a7ff-36c207fc903c req-ac982ad6-2fbc-4b6b-979f-f34652582535 service nova] Creating event network-vif-plugged:cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e for instance e064158b-7b81-42c1-bc01-057812cdcb57 on hv-cinder-83754 Jun 16 17:40:17.784200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-9e24e42e-89a0-4dd8-a7ff-36c207fc903c req-ac982ad6-2fbc-4b6b-979f-f34652582535 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215309 Jun 16 17:40:17.785361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 375/742] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:17.802943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:17.803595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:17.812193 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.812648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.813488 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.814621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.838204 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:17.840108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:17.850368 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.851742 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:17.853302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:17.854092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:18.065112 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:18.073850 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5a1b1ed0-8728-4252-b65b-4f74b7026c3e tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1520 microversion: 2.1 time: 0.276860 Jun 16 17:40:18.074443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 368/743] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:17 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:18.092401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:18.101303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d22bc216-cdc9-4cb1-99a8-3d032a2ba397 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.269430 Jun 16 17:40:18.102780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 376/744] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:17 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:18.437135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:18.438042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:18.447872 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:18.448616 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:18.449831 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:18.450566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:18.604099 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:18.612557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:18.614610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:18.615749 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-31a054e0-bf56-4c5c-8560-2837aba1527d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.184465 Jun 16 17:40:18.616305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 369/745] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:18 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:19.093439 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:19.094266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:19.102055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.102515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.103288 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.103720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.124550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:19.125953 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:19.154406 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.155341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.156767 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.157667 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.365509 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:19.380067 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1bc38bf5-b8dc-4af7-9569-cf2a74925fcd tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1520 microversion: 2.1 time: 0.290343 Jun 16 17:40:19.381598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 377/746] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:19 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:19.473063 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:19.477199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:19.481870 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-564a4a6b-6e05-4c25-b218-5ba4ddc0ff8e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1264 microversion: 2.1 time: 0.365391 Jun 16 17:40:19.482442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 370/747] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:19 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1264 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:19.635737 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:19.636271 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:19.642265 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.642712 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.643469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.643904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.782577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:19.791645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:19.793342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:19.794605 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ea2231da-a567-4768-9947-d40f06b53eab tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.162760 Jun 16 17:40:19.795173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 378/748] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:19 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:19.807260 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-ce5b7535-7c4f-411e-8aa4-8319617873a6 req-c90bc4ba-454c-405e-a0cc-13ee31b44727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "name": "network-vif-unplugged", "status": "completed", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:19.816817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ce5b7535-7c4f-411e-8aa4-8319617873a6 req-c90bc4ba-454c-405e-a0cc-13ee31b44727 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:19.817286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-ce5b7535-7c4f-411e-8aa4-8319617873a6 req-c90bc4ba-454c-405e-a0cc-13ee31b44727 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:19.829545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.compute.server_external_events [req-ce5b7535-7c4f-411e-8aa4-8319617873a6 req-c90bc4ba-454c-405e-a0cc-13ee31b44727 service nova] Unable to find a host for instance bf54c7b6-dc97-4196-bab4-a7698f785a20. Dropping event network-vif-unplugged {{(pid=124160) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 17:40:19.830458 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-ce5b7535-7c4f-411e-8aa4-8319617873a6 req-c90bc4ba-454c-405e-a0cc-13ee31b44727 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027274 Jun 16 17:40:19.831051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 371/749] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 17:40:20.400601 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:20.401256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:20.409832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.410308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.411635 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.412716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.499900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:20.501582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:20.511251 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.511939 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.512883 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.513537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.685267 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:20.697678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3d282bb2-8dac-4eb3-8c13-573da78d5592 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1520 microversion: 2.1 time: 0.300817 Jun 16 17:40:20.699729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 379/750] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:20 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:20.720741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:20.742782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d1a3b716-725a-4a6b-952a-f7b8acb7973c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1450 microversion: 2.1 time: 0.246378 Jun 16 17:40:20.743903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 372/751] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:20 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1450 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:20.766068 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:20.766973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:20.776013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.776822 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.777899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.778407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.814891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:20.815965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:20.831004 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.831463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:20.834095 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:20.834624 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:21.033365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:21.041762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-945d8edc-cb6f-4563-a843-57e38ee75627 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1450 microversion: 2.1 time: 0.283294 Jun 16 17:40:21.042343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 380/752] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:20 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1450 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:21.055819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:21.064937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:21.066532 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:21.068428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4b9aadd3-95a5-4118-a457-9062a3afbfdd tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.258221 Jun 16 17:40:21.069263 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 373/753] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:20 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:21.718867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:21.719477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:21.727369 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:21.727813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:21.728901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:21.729368 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:21.875415 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:21.890489 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-22461c19-4faa-4cd8-aa16-5ba5cda33a1d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1520 microversion: 2.1 time: 0.174914 Jun 16 17:40:21.891528 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 381/754] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:21 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:22.088408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:22.089187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:22.106462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:22.107315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:22.115318 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:22.117353 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:22.347483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:22.365514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:22.368443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:22.370232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1abcdd28-6ab9-40ab-bae7-80043ff9b225 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.285694 Jun 16 17:40:22.370866 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 374/755] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:22 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:22.881782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-89d15f44-756e-4d19-a5d0-371e5f582ece req-a2f8b91c-9540-482c-b920-0c7eafe327d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e064158b-7b81-42c1-bc01-057812cdcb57", "tag": "cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:22.891604 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-89d15f44-756e-4d19-a5d0-371e5f582ece req-a2f8b91c-9540-482c-b920-0c7eafe327d5 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:22.892154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-89d15f44-756e-4d19-a5d0-371e5f582ece req-a2f8b91c-9540-482c-b920-0c7eafe327d5 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:22.906421 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-89d15f44-756e-4d19-a5d0-371e5f582ece req-a2f8b91c-9540-482c-b920-0c7eafe327d5 service nova] Creating event network-changed:cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e for instance e064158b-7b81-42c1-bc01-057812cdcb57 on hv-cinder-83754 Jun 16 17:40:22.912492 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:22.914222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-89d15f44-756e-4d19-a5d0-371e5f582ece req-a2f8b91c-9540-482c-b920-0c7eafe327d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036276 Jun 16 17:40:22.914381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:22.915620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 382/756] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:22.932391 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:22.938362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:22.939418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:22.942276 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.115471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:23.124502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5b1960f0-fde6-4cb4-b4de-45a4b16f6f6a tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.219196 Jun 16 17:40:23.125471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 375/757] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:22 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:23.272561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:23.273973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:23.280696 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.281436 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.282389 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.282827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.317235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:23.335996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b984c2f7-06bf-459c-8924-44b27920afc1 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068308 Jun 16 17:40:23.348985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:23.349518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:23.354535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 383/758] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:23 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:23.356245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.356917 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.358068 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.358661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.394169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:23.395657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:23.407905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.408643 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.409683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:23.410866 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:23.606620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-770acbf0-4dbb-4abe-9a89-23dcefbcc16a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5" status: 200 len: 194 microversion: 2.1 time: 0.263513 Jun 16 17:40:23.607756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 376/759] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 17:40:23 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5 => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:23.937335 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:23.954808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:23.970426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:23.978499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c9ce157b-dc5c-45e4-a6e2-898531fc8372 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.584239 Jun 16 17:40:23.979411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 384/760] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:23 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:24.144529 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:24.146072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:24.158941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:24.159752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:24.162241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:24.162951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:24.351393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:24.359266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-01f09a43-1750-4e40-aa52-3655f77c8d53 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.219055 Jun 16 17:40:24.360374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 377/761] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:24 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:25.000704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:25.001336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:25.009824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.010315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.011633 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.012075 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.194065 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8f65be1-dd60-4c45-b066-fef6030b86db"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:25.195932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:25.202951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.203399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.204177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.204618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.455875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:25.468771 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:25.470805 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:25.472289 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-608c455b-b9e4-4f24-8750-7ecc25031f77 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.475374 Jun 16 17:40:25.472954 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 385/762] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:24 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:25.478510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:25.479495 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:25.487089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.487555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.489040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:25.489612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:25.569348 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0e626d35-e894-4511-8bc0-48e134b413cb tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "POST /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380882 Jun 16 17:40:25.576089 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 378/763] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:40:25 2022] POST /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:40:25.667598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:25.675353 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e40d899d-8f0a-4fee-aacb-fec2620c1d71 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.201358 Jun 16 17:40:25.676681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 386/764] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:25 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:26.493026 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:26.493758 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:26.500994 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:26.501513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:26.502279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:26.502709 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:26.654418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:26.663523 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:26.665038 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:26.666229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-91afa518-7f0b-46d4-b0b7-2efecf472162 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.178868 Jun 16 17:40:26.666780 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 379/765] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:26 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:26.695375 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:26.696038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:26.702466 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:26.702907 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:26.703668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:26.704102 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:26.841975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:26.853585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7f4bef3f-68ec-487f-88bf-93dc4c8d1998 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.162903 Jun 16 17:40:26.854101 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 387/766] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:26 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:27.686716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:27.687330 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:27.695020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:27.695469 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:27.696239 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:27.696673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:27.873565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:27.874326 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:27.882416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:27.882606 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:27.882871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:27.883686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:27.884119 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:27.891022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:27.892698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:27.893892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-00839bb0-e3ee-4157-9d22-d8f799d3d495 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.211048 Jun 16 17:40:27.894439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 380/767] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:27 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:28.032145 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:28.041754 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a103b1ca-ccb4-4383-8de6-383215bcf5f0 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.171974 Jun 16 17:40:28.042483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 388/768] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:27 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:28.913907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:28.914623 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:28.921018 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:28.921499 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:28.922259 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:28.922691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:29.060406 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:29.061900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:29.070484 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:29.071203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:29.072260 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:29.072850 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:29.078205 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:29.089298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:29.091715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:29.092949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c3d5a808-b500-4296-9638-28d8b1656eb5 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.183994 Jun 16 17:40:29.093670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 381/769] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:28 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:29.234025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:29.245993 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d26aa02c-115a-41e5-83f7-570045e232ab tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.189149 Jun 16 17:40:29.249411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 389/770] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:29 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:30.116249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:30.117056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:30.122319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:30.128986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:30.129762 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:30.131725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:30.132448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:30.267721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:30.269367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:30.276813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:30.277290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:30.278072 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:30.278511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:30.314303 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:30.324114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:30.325671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:30.327075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0a9fafb2-7f3c-4eb9-893b-b426207708b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.217950 Jun 16 17:40:30.327952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 382/771] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:30 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:30.436211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:30.445681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-067ddb89-e3c3-42c9-9aea-198353d9e023 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.181761 Jun 16 17:40:30.446374 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 390/772] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:30 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:31.345894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:31.346554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:31.354218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:31.354662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:31.355482 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:31.356087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:31.463902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:31.464779 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:31.466874 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=73 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:31.473372 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:31.474385 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:31.475387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:31.476952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:31.508962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:31.518298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:31.520094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:31.522060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ff0de88a-6372-4fd9-b7b7-516c5d1645c6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.180425 Jun 16 17:40:31.522706 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 383/773] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:31 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:31.681473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:31.689031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6cf9d219-49e8-4c6a-a9ee-8b5303c4ea29 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.229074 Jun 16 17:40:31.689769 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 391/774] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:31 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:32.541304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:32.541912 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:32.548671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:32.549143 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:32.550070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:32.550513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:32.689488 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:32.698679 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:32.700170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:32.701346 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fba0d568-e5c2-454f-817f-0012fc2cb169 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.164019 Jun 16 17:40:32.701898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 384/775] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:32 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:32.707170 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:32.707794 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:32.715014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:32.715469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:32.716244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:32.716686 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:32.855763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:32.863905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bf4b1991-653c-40b5-b13e-ccc6b9937aa1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.160533 Jun 16 17:40:32.865192 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 392/776] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:32 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:33.155039 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:33.156049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:33.162625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.163072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.163834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.164365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.196522 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5581dcc9-0699-44cd-aca2-58385369e314 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045321 Jun 16 17:40:33.197189 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 385/777] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:33 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:33.358341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:33.359515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:33.368571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.369100 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.370310 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.370746 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.403721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-717c2a37-6f0d-4454-a245-214ba5b19719 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5" status: 200 len: 194 microversion: 2.1 time: 0.049699 Jun 16 17:40:33.404543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 393/778] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 17:40:33 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:33.414629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:33.415122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:33.422290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.422974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.424832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.427725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.535884 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:33.541406 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lazy-loading 'services' on Instance uuid fd30c63b-c274-43bd-8322-7f51a2d51166 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:40:33.638445 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a673b0be-3cd2-4e91-b7db-6d1d1120e33e tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5" status: 202 len: 0 microversion: 2.1 time: 0.228023 Jun 16 17:40:33.639533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 386/779] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:40:33 2022] DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/5af6ea86-41fe-47d9-91d2-15e08fe261b5 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:40:33.720857 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:33.722028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:33.729826 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.730687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.732437 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.733698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.883858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:33.884781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:33.892845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.893633 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.894737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:33.895463 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:33.916074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:33.931752 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:33.934248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:33.936918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bf999d4e-e017-444c-be5d-a92a18b96242 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1745 microversion: 2.20 time: 0.220324 Jun 16 17:40:33.937783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 394/780] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:33 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:34.045182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:34.052868 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ef9f2dca-daff-4760-bad4-bdff7d2858d8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.174671 Jun 16 17:40:34.053645 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 387/781] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:33 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:34.961130 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:34.961852 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:34.970637 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:34.971624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:34.973355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:34.985130 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.074148 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:35.075562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:35.091820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:35.092264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.093035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:35.095601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.157483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:35.169733 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:35.174670 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:35.176029 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7b9936bc-1796-4028-9eba-af6357f1c53b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.222842 Jun 16 17:40:35.188514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 395/782] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:34 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:35.300106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:35.310136 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-73c17386-a986-485e-ac62-363b91c6db27 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.242857 Jun 16 17:40:35.311125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 388/783] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:35 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:35.868083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-a9a90045-38d9-47f2-8fbc-5303207843fe req-98fe58d4-4898-4c34-81f1-2a272b4711c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "name": "network-vif-plugged", "status": "completed", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:35.901575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:35.903266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:35.906208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a9a90045-38d9-47f2-8fbc-5303207843fe req-98fe58d4-4898-4c34-81f1-2a272b4711c3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:35.907116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a9a90045-38d9-47f2-8fbc-5303207843fe req-98fe58d4-4898-4c34-81f1-2a272b4711c3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.919650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:35.921879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.923114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:35.924741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:35.945370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-a9a90045-38d9-47f2-8fbc-5303207843fe req-98fe58d4-4898-4c34-81f1-2a272b4711c3 service nova] Creating event network-vif-plugged:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:40:35.952195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-a9a90045-38d9-47f2-8fbc-5303207843fe req-98fe58d4-4898-4c34-81f1-2a272b4711c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088915 Jun 16 17:40:35.953310 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 396/784] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:35.991252 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4af31be8-d3d9-441e-abe5-a8ad3ddbf86f tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/c8f65be1-dd60-4c45-b066-fef6030b86db" status: 200 len: 194 microversion: 2.1 time: 0.093600 Jun 16 17:40:35.992230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 389/785] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jun 16 17:40:35 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/c8f65be1-dd60-4c45-b066-fef6030b86db => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:36.007776 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:36.010373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:36.018883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.020355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.021758 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.022608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.147912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lazy-loading 'services' on Instance uuid fd30c63b-c274-43bd-8322-7f51a2d51166 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:40:36.197129 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:36.197737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:36.213515 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.214695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.218161 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.218642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.268033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d19bb610-fa5b-482a-b03a-fda4e36205d3 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/c8f65be1-dd60-4c45-b066-fef6030b86db" status: 202 len: 0 microversion: 2.1 time: 0.269615 Jun 16 17:40:36.269254 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 397/786] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:40:35 2022] DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments/c8f65be1-dd60-4c45-b066-fef6030b86db => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:40:36.331867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:36.332579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:36.350847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.351297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.352174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:36.352513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:36.648008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:36.658941 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:36.666666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:36.670512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:36.672190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1c25f587-2591-4bf2-8fc5-a26adc827871 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.344948 Jun 16 17:40:36.672960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-402a77ba-9899-40dd-87ef-b6e34848e803 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.481838 Jun 16 17:40:36.674206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 398/787] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:36 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:36.682904 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 390/788] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:36 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:37.569009 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:37.570422 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:37.585486 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.585940 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.586740 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.587182 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.644911 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-71fce93f-80c1-4d5c-9233-8b7973a3f566 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081053 Jun 16 17:40:37.646167 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 399/789] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:37 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:40:37.690467 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:37.691085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:37.699705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:37.700487 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:37.703171 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.704105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.705231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.708268 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.708729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.711330 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.713736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:37.714457 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:37.722143 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:38.012552 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:38.025080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:38.027031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:38.028286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:38.030065 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ef78d21b-0f61-45e4-b11a-f3e51c5e5297 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.333404 Jun 16 17:40:38.031355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 400/790] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:37 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:38.037014 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d373c35b-6ab5-4ea8-adf2-ba6ccf75a57d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1576 microversion: 2.1 time: 0.350503 Jun 16 17:40:38.037814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 391/791] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:37 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1576 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:38.043021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:38.043719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:38.049692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:38.051130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.051130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.052607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.053246 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.055774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:38.070116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.070727 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.072002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.076938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.081588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-83fb46e0-3e79-49ed-8538-04ad45c73f56 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/ips" status: 200 len: 149 microversion: 2.1 time: 0.042864 Jun 16 17:40:38.087886 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 392/792] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:40:38 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:38.093603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-b89e93aa-aa1c-4136-ab40-da80ed416cbd req-8f7ce1d6-9ba1-42eb-a76b-a2fd36f19e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "name": "network-vif-plugged", "status": "completed", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:38.103849 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b89e93aa-aa1c-4136-ab40-da80ed416cbd req-8f7ce1d6-9ba1-42eb-a76b-a2fd36f19e55 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.104591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b89e93aa-aa1c-4136-ab40-da80ed416cbd req-8f7ce1d6-9ba1-42eb-a76b-a2fd36f19e55 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.123661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-b89e93aa-aa1c-4136-ab40-da80ed416cbd req-8f7ce1d6-9ba1-42eb-a76b-a2fd36f19e55 service nova] Creating event network-vif-plugged:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:40:38.129993 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-b89e93aa-aa1c-4136-ab40-da80ed416cbd req-8f7ce1d6-9ba1-42eb-a76b-a2fd36f19e55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040433 Jun 16 17:40:38.131218 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 393/793] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:38.155199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0462c40c-d5a2-4f10-8682-8745ce9adafa tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120379 Jun 16 17:40:38.156093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 401/794] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:38 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 17:40:38.247632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:38.248930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:38.263649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.266486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.268084 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.271920 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.309507 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:40:38.545429 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-368386a9-a4d1-4edc-a45d-849a1b08cfce tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 204 len: 0 microversion: 2.1 time: 0.301028 Jun 16 17:40:38.547744 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 394/795] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:38 2022] DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:40:38.561349 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:38.565695 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:38.579432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.581075 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.582053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:38.583293 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:38.762635 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:38.771320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d3d2bb38-63ac-4538-b5d3-f4a2d417aecf tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1673 microversion: 2.1 time: 0.216270 Jun 16 17:40:38.773332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 402/796] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:38 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:39.052585 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:39.054365 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:39.059566 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:39.060890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:39.061410 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.061860 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.062652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.063090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.084830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.086744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.090689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.092222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.278969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:39.289377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:39.293840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:39.303307 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-63db3612-634f-4f97-9ab7-ba13d6406008 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.256188 Jun 16 17:40:39.303848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 395/797] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:39 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:39.383382 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:39.393445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1c5d4725-9407-49e8-b5eb-87caae6f7234 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1563 microversion: 2.1 time: 0.342060 Jun 16 17:40:39.394615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 403/798] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:39 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1563 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:39.776952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f0f3576-1977-4caa-8e77-70bede154f05"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:39.778010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:39.790918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.791342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:39.792427 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.792692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:39.794262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.794908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.801410 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.802131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:39.803286 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:39.803895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:40.007510 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:40.016440 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6c19d273-6318-4de4-aa29-4fd45119e66d tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1673 microversion: 2.1 time: 0.228320 Jun 16 17:40:40.017030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 404/799] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:39 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:40.325599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:40.326668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:40.352849 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:40.353980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:40.355598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:40.356350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:40.773617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5cce0a16-3104-4b07-86f6-b13bf03f1b7b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "POST /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998927 Jun 16 17:40:40.776404 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 396/800] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:40:39 2022] POST /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:40.782366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:40.794774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:40.804501 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:40.808531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-af85b1ad-5d03-4b7c-8e7e-8fc552d7fbeb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.487795 Jun 16 17:40:40.809607 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 405/801] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:40 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:40:41.040603 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:41.045573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:41.062319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:41.063009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:41.064126 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:41.064742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:41.295513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:41.308152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e0bf767e-86df-4c3f-b879-5e2e3be2e70b tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1673 microversion: 2.1 time: 0.276935 Jun 16 17:40:41.310299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 397/802] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:41 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1673 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:41.841598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:41.843002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:41.860645 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:41.861105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:41.862171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:41.862617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:42.142389 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:42.154409 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:42.156033 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:42.158275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c8b75be6-04fd-45ea-b423-2d490386f67d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.320909 Jun 16 17:40:42.160885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 406/803] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:41 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:42.281594 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-51964046-254c-433c-a9f1-000913a0287f req-9020fac2-8dc4-49a5-9967-05b11607b498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd30c63b-c274-43bd-8322-7f51a2d51166", "name": "network-vif-deleted", "tag": "97934cf6-fabb-41ed-a2c0-382cfdc7a011"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:42.292865 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-51964046-254c-433c-a9f1-000913a0287f req-9020fac2-8dc4-49a5-9967-05b11607b498 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:42.293808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-51964046-254c-433c-a9f1-000913a0287f req-9020fac2-8dc4-49a5-9967-05b11607b498 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:42.307446 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-51964046-254c-433c-a9f1-000913a0287f req-9020fac2-8dc4-49a5-9967-05b11607b498 service nova] Creating event network-vif-deleted:97934cf6-fabb-41ed-a2c0-382cfdc7a011 for instance fd30c63b-c274-43bd-8322-7f51a2d51166 on hv-cinder-83754 Jun 16 17:40:42.318786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-51964046-254c-433c-a9f1-000913a0287f req-9020fac2-8dc4-49a5-9967-05b11607b498 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042191 Jun 16 17:40:42.319401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 398/804] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:42.331871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:42.333389 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:42.340762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:42.341344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:42.342347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:42.342953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:42.454089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faab41439184fecbb3e1021eb81d555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4904f0e2f64e4bef989f441380e843b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:42.465045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8ddd4197-f140-4370-a3ce-1a42a4fd6b8a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 200 len: 1323 microversion: 2.1 time: 0.138905 Jun 16 17:40:42.477963 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 407/805] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:42 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 1323 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:43.185993 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:43.191025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:43.217660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:43.220287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:43.224055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:43.225435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:43.480158 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:43.489607 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:43.490724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:43.515334 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:43.516565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:43.518032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:43.518844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:43.528138 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:43.530660 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:43.532340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fcce114e-e58c-4422-b0e8-746875282284 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.356344 Jun 16 17:40:43.533540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 399/806] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:43 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:43.561802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 HTTP/1.1 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:40:43.566121 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:43.569373 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'fd30c63b-c274-43bd-8322-7f51a2d51166'} Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:43.570426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:43.571796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:43.575593 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:43.577813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2ac87fe4-2bd8-4dff-b1ab-411d6b2c80f5 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 404 len: 111 microversion: 2.1 time: 0.097596 Jun 16 17:40:43.579344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 408/807] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:43 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:43.588031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-29f30289-3004-45b3-a755-8bc723bc0263 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '.version_select at 0x7f84aa313790>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:43.621458 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-29f30289-3004-45b3-a755-8bc723bc0263 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713570164" status: 202 len: 0 microversion: 2.1 time: 0.037201 Jun 16 17:40:43.622647 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 400/808] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713570164 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:40:44.555311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:44.563640 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:44.572011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:44.575548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:44.576745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:44.577416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:44.806986 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:44.818688 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:44.820719 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:44.822448 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-dd2fd991-1dfd-4814-8ef9-da11b69d28ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.272903 Jun 16 17:40:44.834799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 409/809] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:44 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:45.845572 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:45.846846 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:45.855430 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:45.856563 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:45.857978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:45.859102 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:46.085394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:46.094723 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:46.096778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:46.098577 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-37f8a6ce-1b4c-4646-9775-7e9376962ddb tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.259810 Jun 16 17:40:46.099779 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 401/810] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:45 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:47.234610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:47.235894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:47.249262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.250021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.251116 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.251840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.275674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 HTTP/1.1 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:47.280605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.282778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'fd30c63b-c274-43bd-8322-7f51a2d51166'} Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:47.284159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.286976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.292055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:47.295936 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c226f978-31bf-47ff-b860-86561f4c5c07 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 404 len: 111 microversion: 2.1 time: 0.070042 Jun 16 17:40:47.298642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 402/811] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:47 2022] DELETE /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:47.324325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:47.324952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: fd30c63b-c274-43bd-8322-7f51a2d51166] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:47.339195 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.339648 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.340534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.346703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.353092 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:47.367081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 HTTP/1.1 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:47.369903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.371370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'fd30c63b-c274-43bd-8322-7f51a2d51166'} Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:47.372177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. Jun 16 17:40:47.373448 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:47.376747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance fd30c63b-c274-43bd-8322-7f51a2d51166 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:47.378066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-405e7f3f-809d-4adb-bfc0-2e9e1eb88703 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166" status: 404 len: 111 microversion: 2.1 time: 0.074040 Jun 16 17:40:47.379711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 403/812] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:47 2022] GET /compute/v2.1/servers/fd30c63b-c274-43bd-8322-7f51a2d51166 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:47.552002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:47.553882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:47.561869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.562931 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.564136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.564864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.754533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:47.755573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:47.764338 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.764793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.765604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:47.766232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:47.806277 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:47.822293 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:47.823824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:47.825001 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9d398ebb-6a9c-4f1d-9663-e268a53878f2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1740 microversion: 2.20 time: 0.707441 Jun 16 17:40:47.825591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 410/813] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:47 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1740 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:47.892090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lazy-loading 'services' on Instance uuid 9739d117-bf76-4ac4-b172-1ec63768027d {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:40:47.982371 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c4ced56a-5663-4c72-89fb-caf6db2edf9d tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments/1f0f3576-1977-4caa-8e77-70bede154f05" status: 202 len: 0 microversion: 2.1 time: 0.232113 Jun 16 17:40:47.984250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 404/814] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:40:47 2022] DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments/1f0f3576-1977-4caa-8e77-70bede154f05 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:40:48.002002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:48.003394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:48.012647 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.014825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.015902 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.016586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.057380 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9b85af3f-a55d-49d8-8e60-9f272c54eaff tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067762 Jun 16 17:40:48.059585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 411/815] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:47 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:48.664802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:48.664802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:48.676785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.678254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.679737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.680911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.703919 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 HTTP/1.1 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:48.705649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.707740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '2ea8edce-fee8-4dbd-ae01-e4d060cf5597'} Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:48.708531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.711650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.718243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:48.718243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b0fec358-aa7c-4ff4-8acd-9ac987ca4f45 tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 404 len: 111 microversion: 2.1 time: 0.072593 Jun 16 17:40:48.718243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 405/816] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:48 2022] DELETE /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:48.722384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:48.723827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] [instance: 2ea8edce-fee8-4dbd-ae01-e4d060cf5597] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:48.731576 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.732182 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.733066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.734148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.752401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] HTTP exception thrown: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Request method failure captured: Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 HTTP/1.1 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mmjtxhizataTZ-9G2Z03cvYVLptXdBBRkVN2tWpqBEVEldDHrSB1CFWLdZdalIsCg7fr1SOI93RCn8DRlTeyCKCzCN63cCjlDINz7EXHbUcUlJqJNTIqUw5FEQW0cZj2NmpnY90BSa0kStkFko2na6uLcEYMbRC9YTOctitbfnOB4 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:40:48.755229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4904f0e2f64e4bef989f441380e843b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4904f0e2f64e4bef989f441380e843b5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4904f0e2f64e4bef989f441380e843b5"}]}] Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 4904f0e2f64e4bef989f441380e843b5 Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-692723784 Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 3faab41439184fecbb3e1021eb81d555 Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeTestJSON-692723784-project Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.757178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '2ea8edce-fee8-4dbd-ae01-e4d060cf5597'} Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:48.758077 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. Jun 16 17:40:48.759302 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:48.761892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] Returning 404 to user: Instance 2ea8edce-fee8-4dbd-ae01-e4d060cf5597 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:48.763253 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6fb40504-b9a9-4492-afe0-db8e4d62a12a tempest-AttachVolumeTestJSON-692723784 tempest-AttachVolumeTestJSON-692723784-project] 10.222.0.40 "GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597" status: 404 len: 111 microversion: 2.1 time: 0.044796 Jun 16 17:40:48.768051 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 412/817] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:48 2022] GET /compute/v2.1/servers/2ea8edce-fee8-4dbd-ae01-e4d060cf5597 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:48.843814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:48.844671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:48.854928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.855616 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:48.856552 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:48.857421 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.071966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:49.073702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:49.092132 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.092597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.093451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.094149 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.157249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a451645e-8308-45d8-b400-0d3351fb412f tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090783 Jun 16 17:40:49.161795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 413/818] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:40:49 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 17:40:49.229796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:49.231151 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:49.240591 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.241404 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.242432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.243255 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.273198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:40:49.390815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-930a0830-cc99-4c14-b7cd-a7874a074409 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 204 len: 0 microversion: 2.1 time: 0.164932 Jun 16 17:40:49.393445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 414/819] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:49 2022] DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:40:49.405581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:49.406699 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:49.418349 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.419132 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.420594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:49.421236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:49.480550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:49.498380 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:49.501213 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:49.502809 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4913a1cf-c81b-48a8-8d85-dde8b10bc8b8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1722 microversion: 2.20 time: 0.662922 Jun 16 17:40:49.520262 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 406/820] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:48 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1722 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:49.659522 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:49.669182 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c528c4b0-7d5e-4a5c-8f05-7091b28680c4 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1680 microversion: 2.1 time: 0.269936 Jun 16 17:40:49.670249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 415/821] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:49 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:50.527094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:50.528854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:50.546228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:50.547064 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:50.550620 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:50.552527 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:50.696626 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:50.697659 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:50.713217 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:50.713807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:50.714704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:50.715851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:50.771512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:40:50.994335 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:51.009280 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:51.011420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:51.017288 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-96a8b60e-c286-4412-a806-47c2f8c439d9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1722 microversion: 2.20 time: 0.491298 Jun 16 17:40:51.018423 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 407/822] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:50 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:51.161649 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:51.171932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2ca3b185-aa3d-427f-bf7d-f8bb231437e1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1680 microversion: 2.1 time: 0.479675 Jun 16 17:40:51.182592 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 416/823] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:50 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1680 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:52.036565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:52.037483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:52.048322 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:52.051263 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:52.053854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:52.054592 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:52.204843 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:52.205561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:52.222452 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:52.223556 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:52.231967 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:52.232432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:52.467241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:52.482666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:52.484504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:52.485790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-88d3d3d3-6ed7-4283-858a-b20b52e82583 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1722 microversion: 2.20 time: 0.453324 Jun 16 17:40:52.498145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 408/824] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:52 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:52.663426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:52.672601 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-edc2c37a-b078-40d5-a8ee-9a9d5e7dffb1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1680 microversion: 2.1 time: 0.485746 Jun 16 17:40:52.675026 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 417/825] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:52 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1680 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:40:53.506140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:53.506748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:53.517051 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:53.517533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:53.518317 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:53.518750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:53.693916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-5fef44c5-6c58-4a98-ae8e-9f492ea848da req-ce054f5b-ab75-4a9f-a382-031b9b696b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "name": "network-vif-unplugged", "status": "completed", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:53.712323 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-5fef44c5-6c58-4a98-ae8e-9f492ea848da req-ce054f5b-ab75-4a9f-a382-031b9b696b61 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:53.712835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-5fef44c5-6c58-4a98-ae8e-9f492ea848da req-ce054f5b-ab75-4a9f-a382-031b9b696b61 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:53.764973 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.compute.server_external_events [req-5fef44c5-6c58-4a98-ae8e-9f492ea848da req-ce054f5b-ab75-4a9f-a382-031b9b696b61 service nova] Unable to find a host for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace. Dropping event network-vif-unplugged {{(pid=124161) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 17:40:53.766059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-5fef44c5-6c58-4a98-ae8e-9f492ea848da req-ce054f5b-ab75-4a9f-a382-031b9b696b61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.081117 Jun 16 17:40:53.767798 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 418/826] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 17:40:53.783803 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:53.784567 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:53.797863 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:53.798326 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:53.806500 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:53.806988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:54.073793 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209ada6ba12b4bfda10045b4ee9301f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63c592c0afb4dfc9dd5b36be791decd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:54.083862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fe6ef209-60c8-4925-8f25-24c41bd589ea tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 200 len: 1613 microversion: 2.1 time: 0.314991 Jun 16 17:40:54.088292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 419/827] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:53 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 1613 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:40:54.104508 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-39e1f626-86be-4500-8b0e-529859178276 req-0c48c172-9fe4-4810-a1ad-d1b745c7b35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9739d117-bf76-4ac4-b172-1ec63768027d", "name": "network-vif-deleted", "tag": "c4cf8f46-c85c-4601-8250-462de6025ebf"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:54.114735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-39e1f626-86be-4500-8b0e-529859178276 req-0c48c172-9fe4-4810-a1ad-d1b745c7b35c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:54.115432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-39e1f626-86be-4500-8b0e-529859178276 req-0c48c172-9fe4-4810-a1ad-d1b745c7b35c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:54.134997 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-39e1f626-86be-4500-8b0e-529859178276 req-0c48c172-9fe4-4810-a1ad-d1b745c7b35c service nova] Creating event network-vif-deleted:c4cf8f46-c85c-4601-8250-462de6025ebf for instance 9739d117-bf76-4ac4-b172-1ec63768027d on hv-cinder-83754 Jun 16 17:40:54.136601 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:54.143314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-39e1f626-86be-4500-8b0e-529859178276 req-0c48c172-9fe4-4810-a1ad-d1b745c7b35c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053254 Jun 16 17:40:54.144828 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 420/828] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:40:54.149593 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:54.153739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:54.156631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2b2a747c-fac4-4867-a803-7f22e9bcf4ed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1665 microversion: 2.20 time: 0.654500 Jun 16 17:40:54.163203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 409/829] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:53 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1665 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:54.193497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "538e4f8b-19f1-4f3d-ad63-42d5c994961f"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:54.193497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:54.202725 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:54.204210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:54.206447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:54.206977 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:54.831311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b2a795cc-351e-462f-bf60-14da1df85e62 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.651320 Jun 16 17:40:54.833549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 421/830] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jun 16 17:40:54 2022] POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments => generated 188 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:40:55.010440 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:55.016295 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:55.025651 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.026789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:55.028288 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.028960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:55.106005 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:55.106731 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:55.114468 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.114867 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:55.115649 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.116085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:55.134084 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d HTTP/1.1 Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:40:55.135560 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:55.136933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '9739d117-bf76-4ac4-b172-1ec63768027d'} Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:55.137788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:55.139070 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:40:55.140273 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:55.140273 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6f7a0f8c-05cd-4af9-b1a2-c3e50de2f333 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 404 len: 111 microversion: 2.1 time: 0.035076 Jun 16 17:40:55.142554 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 422/831] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:55 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:55.148838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2cfe8a69-4370-4f76-b6e9-244a06447ce1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '.version_select at 0x7f84aa1f0dc0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:55.180350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2cfe8a69-4370-4f76-b6e9-244a06447ce1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241393700" status: 202 len: 0 microversion: 2.1 time: 0.036626 Jun 16 17:40:55.181262 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 423/832] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jun 16 17:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241393700 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:40:55.713444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-df2e23cc-a27a-4578-ad76-41b622f557a9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments/538e4f8b-19f1-4f3d-ad63-42d5c994961f" status: 202 len: 0 microversion: 2.20 time: 0.716007 Jun 16 17:40:55.714557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 410/833] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jun 16 17:40:54 2022] DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments/538e4f8b-19f1-4f3d-ad63-42d5c994961f => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:40:55.852829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:40:55.854166 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:55.883131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.883131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:55.888950 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:55.889824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:56.308996 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ed57b61b-6a31-409c-b4e2-9db3a5c99304 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/action" status: 202 len: 0 microversion: 2.20 time: 0.459263 Jun 16 17:40:56.309965 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 424/834] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jun 16 17:40:55 2022] POST /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:40:56.319169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:56.320534 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:56.334464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:56.338041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:56.339025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:56.339657 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:56.792442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:56.806073 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:56.808798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:56.814376 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f76e4f39-7f0f-4fee-930b-2ca4a836a2f3 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1673 microversion: 2.20 time: 0.500474 Jun 16 17:40:56.815551 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 411/835] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:56 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1673 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:57.836180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:57.836713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:57.850050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:57.853503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:57.856153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:57.856153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:58.144514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:58.145386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:58.173963 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:58.175287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:58.178661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:58.179281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:58.247199 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d HTTP/1.1 Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:58.251962 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.254627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '9739d117-bf76-4ac4-b172-1ec63768027d'} Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:58.255559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.257070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.260595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:58.264900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7cd8023d-5341-41e8-981d-219096e129c9 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 404 len: 111 microversion: 2.1 time: 0.125661 Jun 16 17:40:58.267985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 412/836] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:58 2022] DELETE /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:40:58.288821 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:58.289507 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 9739d117-bf76-4ac4-b172-1ec63768027d] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:58.319605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:58.320241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:58.321306 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:58.321760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:58.373331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d HTTP/1.1 Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:58.380820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.382619 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '9739d117-bf76-4ac4-b172-1ec63768027d'} Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:58.383538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. Jun 16 17:40:58.385902 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:58.389010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 9739d117-bf76-4ac4-b172-1ec63768027d could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:58.391237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-38f0ce0d-8de0-40bd-9370-c2e4e573a1d1 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d" status: 404 len: 111 microversion: 2.1 time: 0.116774 Jun 16 17:40:58.395560 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 413/837] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:58 2022] GET /compute/v2.1/servers/9739d117-bf76-4ac4-b172-1ec63768027d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:58.657790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:58.670572 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:58.676503 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:40:58.678974 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5dd37570-4154-43c3-baf8-5aa31601a568 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1673 microversion: 2.20 time: 0.848325 Jun 16 17:40:58.680779 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 425/838] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:57 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1673 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:40:59.717076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:59.717731 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:59.718416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:59.719164 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:59.735083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.740640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.741723 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.743143 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.743770 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.744387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.746026 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.749499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.783565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 HTTP/1.1 Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:59.790466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.792096 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'a84a8707-8182-47fa-b359-249a10a44e48'} Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:59.792900 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.794312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.799126 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:59.800819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2ab3ca1a-c843-4e16-bb10-39381ce0aff3 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 404 len: 111 microversion: 2.1 time: 0.101467 Jun 16 17:40:59.802687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 414/839] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:59 2022] DELETE /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:59.814324 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:59.815422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: a84a8707-8182-47fa-b359-249a10a44e48] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:59.825326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.826106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.827267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.828963 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.854123 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 HTTP/1.1 Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:59.860167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.861834 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'a84a8707-8182-47fa-b359-249a10a44e48'} Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:59.862733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. Jun 16 17:40:59.864662 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.868584 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance a84a8707-8182-47fa-b359-249a10a44e48 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:59.870863 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bcee4041-3732-472a-b3f2-7ab6f290fa4b tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48" status: 404 len: 111 microversion: 2.1 time: 0.060044 Jun 16 17:40:59.871996 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 415/840] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:59 2022] GET /compute/v2.1/servers/a84a8707-8182-47fa-b359-249a10a44e48 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:40:59.886681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:59.887784 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:59.902531 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.903449 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.904703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.905547 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.925711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb HTTP/1.1 Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:40:59.928439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:40:59.930139 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb'} Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:40:59.930943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:40:59.932245 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:40:59.935632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:40:59.936809 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-58d27c8e-5ac8-4301-aba4-680f7dcecc32 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 404 len: 111 microversion: 2.1 time: 0.060079 Jun 16 17:40:59.938027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 416/841] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:40:59 2022] DELETE /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 17:40:59.948389 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:40:59.949779 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:40:59.958715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.959948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.961088 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:40:59.961930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:40:59.994604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb HTTP/1.1 Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:00.000712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:41:00.002275 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb'} Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:00.003050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. Jun 16 17:41:00.007211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:00.011670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance 3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:00.012760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f78b0f33-0730-46d5-842c-ce696123c9ac tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb" status: 404 len: 111 microversion: 2.1 time: 0.069309 Jun 16 17:41:00.014083 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 417/842] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:40:59 2022] GET /compute/v2.1/servers/3ef90d7f-25eb-4945-b73d-30a1d1fd6ecb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:00.106385 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:00.124799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:00.126762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:00.128231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-174f6c0b-b033-45a6-908c-a9599095b2ea tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1675 microversion: 2.20 time: 0.419100 Jun 16 17:41:00.129745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 426/843] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:40:59 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1675 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:01.149465 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:01.150924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:01.157422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:01.159398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.161367 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.162432 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.163104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.306824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:01.307899 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:01.317826 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.318919 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.319947 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.320555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.342767 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e HTTP/1.1 Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:01.344800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.346193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'e052a589-f2aa-4711-8beb-2171defad99e'} Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:01.347531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.349117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.353180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:01.354367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6a053eed-1e88-4dc0-b691-ba2a5754d709 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 404 len: 111 microversion: 2.1 time: 0.055770 Jun 16 17:41:01.360403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 427/844] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:41:01 2022] DELETE /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:01.368127 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:01.368747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] [instance: e052a589-f2aa-4711-8beb-2171defad99e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:01.386592 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.387044 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.387831 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:01.388416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:01.416938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] HTTP exception thrown: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Request method failure captured: Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e HTTP/1.1 Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2mk2lbWZWx8hk2hrHkvqrgDlm_DoGo-tpbz1M9A3lzm93s7P0uyLl7kVkcO3V3Yf03z48fIQqyUSMFSh4Vskod1Zq02TFCTzSSbU0JFKcka6osGNVAHmj0NjznAR-n2SdN60ZAXu1iqV0TAayPdWbPKdKbUxEW-WSWuau3fI5zlc5I Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:01.420215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d63c592c0afb4dfc9dd5b36be791decd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d63c592c0afb4dfc9dd5b36be791decd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d63c592c0afb4dfc9dd5b36be791decd"}]}] Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: d63c592c0afb4dfc9dd5b36be791decd Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344547187 Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 209ada6ba12b4bfda10045b4ee9301f1 Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeNegativeTest-1344547187-project Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.421693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'e052a589-f2aa-4711-8beb-2171defad99e'} Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:01.422681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. Jun 16 17:41:01.424332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:01.428135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] Returning 404 to user: Instance e052a589-f2aa-4711-8beb-2171defad99e could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:01.428135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c1f90357-4d3d-40b7-a7d2-2766b8b42a67 tempest-AttachVolumeNegativeTest-1344547187 tempest-AttachVolumeNegativeTest-1344547187-project] 10.222.0.40 "GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e" status: 404 len: 111 microversion: 2.1 time: 0.058985 Jun 16 17:41:01.428135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 428/845] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:01 2022] GET /compute/v2.1/servers/e052a589-f2aa-4711-8beb-2171defad99e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:01.466117 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:01.479455 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:01.482243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:01.483743 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f2ec3983-0ae3-4451-9ddd-0361b4de2514 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.338886 Jun 16 17:41:01.487117 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 418/846] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:01 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:02.506575 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:02.507186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:02.523477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:02.530570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:02.536418 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:02.537786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:02.541796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:03.770795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:03.786154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:03.788448 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:03.803499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5b29aeee-1f9d-469f-a823-9ab2b06cd37b tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 1.301158 Jun 16 17:41:03.805486 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 429/847] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:02 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:04.834028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:04.836105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:04.853203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:04.860428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:04.864983 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:04.866327 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:05.571468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:05.595535 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:05.611582 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:05.617316 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b57ac492-2674-4df1-9e2e-ecf988caaa35 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.788514 Jun 16 17:41:05.623513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 419/848] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:04 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:06.650369 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:06.651595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:06.674252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:06.683390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:06.684545 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:06.685222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:07.328160 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:07.382359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:07.396924 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:07.411571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d74219d0-42be-44a1-b538-b1d671d2a4b1 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.764142 Jun 16 17:41:07.433594 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 430/849] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:06 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:08.451965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:08.453076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:08.483306 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:08.485665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:08.486559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:08.486997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:09.068025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:09.118930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:09.129023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:09.134127 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-05e57039-ad0e-4071-a517-d30792d184a0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.687703 Jun 16 17:41:09.140039 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 420/850] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:08 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:10.172230 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:10.178892 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:10.221453 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:10.229672 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:10.232083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:10.233813 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:10.908575 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:10.924317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:10.933824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:10.943580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8965ee3e-a6de-4067-b892-9febbaba5cb0 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.787487 Jun 16 17:41:10.957203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 431/851] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:10 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:11.973248 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:11.978735 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:12.003521 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:12.010604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:12.019562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:12.021175 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:12.610863 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:12.635568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:12.670228 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:12.683997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cb972dce-c91d-4907-b319-c25adeadfeed tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.706173 Jun 16 17:41:12.683997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 421/852] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:11 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:13.725753 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:13.728350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:13.756134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:13.757136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:13.761525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:13.762483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:14.350590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:14.382584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:14.384947 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:14.386874 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6e9f6a8b-9c6d-4e80-828e-d93869aece53 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.678401 Jun 16 17:41:14.398172 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 432/853] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:13 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:15.412024 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:15.412679 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:15.423494 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:15.430826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:15.432005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:15.432606 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:15.451440 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:15.728759 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:15.745125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:15.747030 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:15.749754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cb8daa6b-bd74-4f72-8195-841987475800 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.342648 Jun 16 17:41:15.751256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 422/854] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:15 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:16.771060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:16.772380 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:16.788537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:16.789581 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:16.794619 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:16.810758 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:16.982818 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:16.992739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:16.999651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:17.001644 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:17.004042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1ff7dc4e-5ab1-487e-b547-1d877f10b133 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.237794 Jun 16 17:41:17.006027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 433/855] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:16 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:17.137957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2a7c35f2-81ee-4f7f-b1a6-4c874cb7c8ba tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Action: 'create', calling method: .version_select at 0x7f84aa326160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1204844389"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:17.779711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2a7c35f2-81ee-4f7f-b1a6-4c874cb7c8ba tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.987754 Jun 16 17:41:17.781313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 423/856] 10.222.0.40 () {60 vars in 1154 bytes} [Thu Jun 16 17:41:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 990 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 17:41:17.792715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-07e0aebb-0b50-4503-a789-46edc8b46dd6 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa326af0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:17.870341 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-07e0aebb-0b50-4503-a789-46edc8b46dd6 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 200 len: 345 microversion: 2.1 time: 0.081295 Jun 16 17:41:17.871934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 434/857] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:17 2022] GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:18.025813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:18.026859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:18.042878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:18.047514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:18.052261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:18.052886 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:18.278243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:18.298774 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:18.302001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:18.303921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-930a9d10-c206-4e1e-a177-501769b83fb8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.282943 Jun 16 17:41:18.304996 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 424/858] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:18 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:18.886596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c80c0497-788f-4fc4-bb7b-66d897659ad8 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa4574c0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:18.993967 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c80c0497-788f-4fc4-bb7b-66d897659ad8 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 200 len: 346 microversion: 2.1 time: 0.111709 Jun 16 17:41:18.994823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 435/859] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:18 2022] GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:19.007229 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7ffbe5dc-eb43-4eb1-ac41-a67d5c8b2543 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Action: 'create', calling method: .version_select at 0x7f84aa49d0d0>, body: {"snapshot": {"volume_id": "3177a94b-7129-47e2-8515-46cb82bb5c18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1982148931"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:19.284498 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7ffbe5dc-eb43-4eb1-ac41-a67d5c8b2543 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.281718 Jun 16 17:41:19.285441 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 425/860] 10.222.0.40 () {60 vars in 1161 bytes} [Thu Jun 16 17:41:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:19.302015 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0111032c-9251-4b95-b3fa-a77f0fac5757 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa457430>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:19.326935 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:19.328208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:19.361975 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:19.363671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:19.364105 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:19.364824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:19.415231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0111032c-9251-4b95-b3fa-a77f0fac5757 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 287 microversion: 2.1 time: 0.118497 Jun 16 17:41:19.417210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 436/861] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:19 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:19.431953 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-777f30dd-a85b-4f46-9c05-291dd0f2ae37 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa4579d0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:19.504015 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-777f30dd-a85b-4f46-9c05-291dd0f2ae37 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.080415 Jun 16 17:41:19.504599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 437/862] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jun 16 17:41:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:41:19.524909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f0e8463b-8434-4aa0-9bd8-ccb56adf5e33 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa326430>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:19.588780 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f0e8463b-8434-4aa0-9bd8-ccb56adf5e33 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 287 microversion: 2.1 time: 0.073184 Jun 16 17:41:19.589707 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 438/863] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:19 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:19.616664 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:19.625468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:19.627209 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:19.629525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2a273eda-dd2e-408c-9884-c9e06e7c2226 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.311190 Jun 16 17:41:19.639074 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 426/864] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:19 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:41:20.604959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-27aa6251-5753-44f4-b060-793a358dafa5 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa3261f0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:20.646885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-27aa6251-5753-44f4-b060-793a358dafa5 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 287 microversion: 2.1 time: 0.046674 Jun 16 17:41:20.651031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 439/865] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:20 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:20.656277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:20.657701 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:20.666113 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:20.666652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:20.667550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:20.667991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:20.832739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:20.841557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:20.843086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:20.844299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9b64768b-76c8-4e1d-ac63-dd9c2b10d4b6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.191871 Jun 16 17:41:20.844865 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 427/866] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:20 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:21.590882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4b5fec21-5b13-44be-954a-9697980d758e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'create', calling method: .version_select at 0x7f84aa326af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1089942978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7MBY3hWQRQDViGVemo2h5rl8CgBjNOKOP4CfDSUlkN+enYJ4xDPBBbkSqmy5AoHSFVx1CWzQ9rFYenvzmrM0EdrVV9HY9rS3vzSVSr4mBL0XVjJG523pYSJIITNm0DFA=="}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:21.608216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4b5fec21-5b13-44be-954a-9697980d758e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Getting quotas for project ad7c8fc06d764104b1c7107b48d8dddc. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:41:21.612719 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4b5fec21-5b13-44be-954a-9697980d758e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Getting quotas for user af7be60f65da43f982c1ec2e91397051 and project ad7c8fc06d764104b1c7107b48d8dddc. Resources: {'key_pairs'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:41:21.639818 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4b5fec21-5b13-44be-954a-9697980d758e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052613 Jun 16 17:41:21.644689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 440/867] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jun 16 17:41:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:21.659317 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f5ac3230-ebbb-473e-b6cf-2ac795ad5ce9 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa4961f0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:21.695381 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f5ac3230-ebbb-473e-b6cf-2ac795ad5ce9 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 287 microversion: 2.1 time: 0.040170 Jun 16 17:41:21.696305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 428/868] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:21 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:21.759539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-842879554", "imageRef": "35d5d5ac-6069-4194-9594-928191af227a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1089942978", "networks": [{"uuid": "a9d8618e-26e4-4cf3-ab6a-5013cb00a484"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:21.826325 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] validate_networks() for [('a9d8618e-26e4-4cf3-ab6a-5013cb00a484', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:41:21.864627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:21.865641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:21.872762 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:21.873822 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:21.874006 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:21.874443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:22.103276 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:22.115485 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:22.116999 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:22.118296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-685b7619-cae1-488b-91a1-bb53b02826b2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.258194 Jun 16 17:41:22.118876 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 429/869] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:21 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:41:22.337551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:41:22.338005 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:41:22.338487 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:41:22.338901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:41:22.339320 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:41:22.349261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:22.349716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:22.350524 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:22.350960 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:22.369209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Getting quotas for project ad7c8fc06d764104b1c7107b48d8dddc. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:41:22.373387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Getting quotas for user af7be60f65da43f982c1ec2e91397051 and project ad7c8fc06d764104b1c7107b48d8dddc. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:41:22.386017 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:41:22.388432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35d5d5ac-6069-4194-9594-928191af227a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:41:22.438352 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5a5def99-ec1a-4746-bb9c-03a12e98ed26 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682782 Jun 16 17:41:22.439080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 441/870] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:41:22.451322 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e7be86a9-e48e-4e8b-9015-56f0d74b4671 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:22.452034 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e7be86a9-e48e-4e8b-9015-56f0d74b4671 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:22.517794 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e7be86a9-e48e-4e8b-9015-56f0d74b4671 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:22.525495 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e7be86a9-e48e-4e8b-9015-56f0d74b4671 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1258 microversion: 2.1 time: 0.077998 Jun 16 17:41:22.526695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 430/871] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:22 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:22.709022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-16e25f02-4d04-48fd-ace9-b04f294a0ff5 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa2f50d0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:22.743614 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-16e25f02-4d04-48fd-ace9-b04f294a0ff5 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 288 microversion: 2.1 time: 0.039517 Jun 16 17:41:22.744361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 442/872] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:22 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:22.755908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1b051719-3024-4009-b191-e242858d0026 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa4589d0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:22.822045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1b051719-3024-4009-b191-e242858d0026 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 202 len: 0 microversion: 2.1 time: 0.070673 Jun 16 17:41:22.822629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 431/873] 10.222.0.40 () {58 vars in 1253 bytes} [Thu Jun 16 17:41:22 2022] DELETE /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:41:22.831909 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8254f7a1-6a32-404a-a416-419bd3e08acc tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa426d30>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:22.883839 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8254f7a1-6a32-404a-a416-419bd3e08acc tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 200 len: 287 microversion: 2.1 time: 0.053877 Jun 16 17:41:22.884445 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 443/874] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:22 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:23.138194 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:23.138826 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:23.147905 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:23.148048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:23.149087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:23.149565 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:23.318658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:23.327167 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:23.328670 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:23.329859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d29934ec-3995-4aea-a01e-7188187116ca tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.195809 Jun 16 17:41:23.330605 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 432/875] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:23 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:23.546848 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:23.547739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:23.554494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:23.554944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:23.555739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:23.556185 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:23.628238 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:23.636449 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3b7383d8-36e8-4f95-b245-cc7fe41509d0 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1310 microversion: 2.1 time: 0.094142 Jun 16 17:41:23.646397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 444/876] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:23 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:23.900677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1909d2af-7893-4947-8c4c-137e136bf981 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa4995e0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:23.939964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-1909d2af-7893-4947-8c4c-137e136bf981 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] HTTP exception thrown: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1909d2af-7893-4947-8c4c-137e136bf981 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Request method failure captured: Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 HTTP/1.1 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2s8eqwYlxNTDtKz0mZ959IR19MctmowHAs1LBt-AboSo-14hKUkglpgYnOm6S97DkIZzC9z3etVA3HO4UaIKDOr38qj0AYxq19ePX51seUyaukcmHm7Xp7aoH-cmtwPmF4nKFja6z3z1fuEYX-GUgNfI6ln5p_PNvWWqRKqTUVe0Dc Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:23.943255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c7add0887fb448cb8f95761b746c5f00", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c7add0887fb448cb8f95761b746c5f00"}]}] Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: d0422683c5af464b8361d211a19f50ba Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '96b203c1-f24c-4a92-b9f7-a3a516662051'} Jun 16 17:41:23.944991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. (HTTP 404) (Request-ID: req-26f4b5ad-db70-44a0-a864-69ac4a8dcaa3) Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.946177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:23.947589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 17:41:23.948894 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. Jun 16 17:41:23.950514 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:23.952250 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1909d2af-7893-4947-8c4c-137e136bf981 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Returning 404 to user: Snapshot 96b203c1-f24c-4a92-b9f7-a3a516662051 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:23.953299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1909d2af-7893-4947-8c4c-137e136bf981 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051" status: 404 len: 111 microversion: 2.1 time: 0.060895 Jun 16 17:41:23.954002 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 433/877] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:41:23 2022] GET /compute/v2.1/os-snapshots/96b203c1-f24c-4a92-b9f7-a3a516662051 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:23.963106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c408095d-2fb3-417d-9d96-b3c7cb9e92f4 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa426940>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:24.078596 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c408095d-2fb3-417d-9d96-b3c7cb9e92f4 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 202 len: 0 microversion: 2.1 time: 0.118720 Jun 16 17:41:24.079637 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 445/878] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:41:23 2022] DELETE /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:41:24.090644 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-83fab56e-3186-4337-8823-2ebac18b78c8 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa2a1670>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:24.167528 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-83fab56e-3186-4337-8823-2ebac18b78c8 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 200 len: 345 microversion: 2.1 time: 0.083355 Jun 16 17:41:24.168319 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 434/879] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:24 2022] GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:24.351539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:24.351539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:24.359011 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:24.359865 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:24.360770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:24.362242 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:24.656012 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:24.656629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:24.672685 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:24.673130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:24.674232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:24.675572 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:24.844554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:24.874410 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c282b1ce-0d4a-4591-aa7b-f38b638e5a4a tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1316 microversion: 2.1 time: 0.222280 Jun 16 17:41:24.876418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 435/880] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:24 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:24.890243 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:24.935744 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:24.937622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:24.951735 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7bb9924a-32b1-4973-a6dd-b6a50f271bbf tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.593992 Jun 16 17:41:24.953690 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 446/881] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:24 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:25.183512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fbc26d76-2bc8-478d-8b39-b737b95a090f tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa2a1310>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:25.256165 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-fbc26d76-2bc8-478d-8b39-b737b95a090f tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] HTTP exception thrown: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fbc26d76-2bc8-478d-8b39-b737b95a090f tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Request method failure captured: Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 HTTP/1.1 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2s8eqwYlxNTDtKz0mZ959IR19MctmowHAs1LBt-AboSo-14hKUkglpgYnOm6S97DkIZzC9z3etVA3HO4UaIKDOr38qj0AYxq19ePX51seUyaukcmHm7Xp7aoH-cmtwPmF4nKFja6z3z1fuEYX-GUgNfI6ln5p_PNvWWqRKqTUVe0Dc Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:25.258629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c7add0887fb448cb8f95761b746c5f00", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c7add0887fb448cb8f95761b746c5f00"}]}] Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: d0422683c5af464b8361d211a19f50ba Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '3177a94b-7129-47e2-8515-46cb82bb5c18'} Jun 16 17:41:25.260439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. (HTTP 404) (Request-ID: req-9eb1cb10-6f06-4bd3-bbc9-8b18e4c116c4) Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.261596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:25.263211 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:41:25.264793 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fbc26d76-2bc8-478d-8b39-b737b95a090f tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Returning 404 to user: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:25.266462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fbc26d76-2bc8-478d-8b39-b737b95a090f tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 404 len: 109 microversion: 2.1 time: 0.084030 Jun 16 17:41:25.272760 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 436/882] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:25 2022] GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:25.284025 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2b229c5d-5f63-431e-a20e-e594115eb236 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa326dc0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:25.354584 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-2b229c5d-5f63-431e-a20e-e594115eb236 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] HTTP exception thrown: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2b229c5d-5f63-431e-a20e-e594115eb236 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Request method failure captured: Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 HTTP/1.1 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2s8eqwYlxNTDtKz0mZ959IR19MctmowHAs1LBt-AboSo-14hKUkglpgYnOm6S97DkIZzC9z3etVA3HO4UaIKDOr38qj0AYxq19ePX51seUyaukcmHm7Xp7aoH-cmtwPmF4nKFja6z3z1fuEYX-GUgNfI6ln5p_PNvWWqRKqTUVe0Dc Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:25.358631 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c7add0887fb448cb8f95761b746c5f00", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c7add0887fb448cb8f95761b746c5f00"}]}] Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: d0422683c5af464b8361d211a19f50ba Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '3177a94b-7129-47e2-8515-46cb82bb5c18'} Jun 16 17:41:25.361609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. (HTTP 404) (Request-ID: req-d189566c-1a17-4313-887e-c1f0dee1184d) Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.363354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:25.366038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:41:25.368379 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.370890 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.380624 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2b229c5d-5f63-431e-a20e-e594115eb236 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Returning 404 to user: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:25.383235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2b229c5d-5f63-431e-a20e-e594115eb236 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 404 len: 109 microversion: 2.1 time: 0.107435 Jun 16 17:41:25.384609 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 447/883] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:41:25 2022] DELETE /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:25.398243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f18e6fd6-b931-4f15-b078-d2535e94de90 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Calling method '.version_select at 0x7f84aa499700>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:25.447625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-f18e6fd6-b931-4f15-b078-d2535e94de90 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] HTTP exception thrown: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f18e6fd6-b931-4f15-b078-d2535e94de90 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Request method failure captured: Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 HTTP/1.1 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2s8eqwYlxNTDtKz0mZ959IR19MctmowHAs1LBt-AboSo-14hKUkglpgYnOm6S97DkIZzC9z3etVA3HO4UaIKDOr38qj0AYxq19ePX51seUyaukcmHm7Xp7aoH-cmtwPmF4nKFja6z3z1fuEYX-GUgNfI6ln5p_PNvWWqRKqTUVe0Dc Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:25.457188 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7add0887fb448cb8f95761b746c5f00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c7add0887fb448cb8f95761b746c5f00", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c7add0887fb448cb8f95761b746c5f00"}]}] Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: c7add0887fb448cb8f95761b746c5f00 Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1987580618 Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: d0422683c5af464b8361d211a19f50ba Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1987580618-project Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '3177a94b-7129-47e2-8515-46cb82bb5c18'} Jun 16 17:41:25.459385 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. (HTTP 404) (Request-ID: req-5b29fa36-c7a9-4451-92d0-2d1453e03f15) Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.460587 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:25.461836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:41:25.463329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f18e6fd6-b931-4f15-b078-d2535e94de90 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] Returning 404 to user: Volume 3177a94b-7129-47e2-8515-46cb82bb5c18 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:25.470197 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f18e6fd6-b931-4f15-b078-d2535e94de90 tempest-VolumesSnapshotsTestJSON-1987580618 tempest-VolumesSnapshotsTestJSON-1987580618-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18" status: 404 len: 109 microversion: 2.1 time: 0.070101 Jun 16 17:41:25.476677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 437/884] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:25 2022] GET /compute/v2.1/os-volumes/3177a94b-7129-47e2-8515-46cb82bb5c18 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:25.914002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:25.919880 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:25.951720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:25.957877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:25.959469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:25.963689 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:25.984304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:25.985390 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:25.995642 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:25.999911 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:26.010986 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:26.013884 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:26.718044 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:26.744536 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:26.746186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:26.747763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:26.753433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-165f137a-62ab-4aee-8274-259901888792 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.767658 Jun 16 17:41:26.754378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 438/885] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:25 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:41:26.763227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-827421a7-09a1-4294-b082-633633f87ac5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.858403 Jun 16 17:41:26.769681 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 448/886] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:25 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:27.722115 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-8e6d0a7f-0296-45f1-8f23-ae65b9891fa9 req-242da843-3258-4d44-9fcd-eaeaae3696bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:27.769046 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8e6d0a7f-0296-45f1-8f23-ae65b9891fa9 req-242da843-3258-4d44-9fcd-eaeaae3696bd service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:27.771270 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-8e6d0a7f-0296-45f1-8f23-ae65b9891fa9 req-242da843-3258-4d44-9fcd-eaeaae3696bd service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:27.790106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:27.790922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:27.803893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:27.804562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:27.806807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:27.807284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:27.840841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-8e6d0a7f-0296-45f1-8f23-ae65b9891fa9 req-242da843-3258-4d44-9fcd-eaeaae3696bd service nova] Creating event network-changed:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:41:27.851008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-8e6d0a7f-0296-45f1-8f23-ae65b9891fa9 req-242da843-3258-4d44-9fcd-eaeaae3696bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141392 Jun 16 17:41:27.854122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 439/887] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:27.869524 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:27.882673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:27.908696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:27.918554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:27.921768 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:27.923364 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:29.002702 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:29.028297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3f537f89-6121-492c-a34d-676ccdd34f7d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 1.241273 Jun 16 17:41:29.031975 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 449/888] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:27 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:29.043756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-52c666be-6100-443c-9f7e-6a3c00699ce8 req-b46d8e7e-b627-4057-be1f-7342b0aadfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "name": "network-vif-plugged", "status": "completed", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:29.055814 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-52c666be-6100-443c-9f7e-6a3c00699ce8 req-b46d8e7e-b627-4057-be1f-7342b0aadfca service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:29.056578 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-52c666be-6100-443c-9f7e-6a3c00699ce8 req-b46d8e7e-b627-4057-be1f-7342b0aadfca service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:29.090125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-52c666be-6100-443c-9f7e-6a3c00699ce8 req-b46d8e7e-b627-4057-be1f-7342b0aadfca service nova] Creating event network-vif-plugged:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:41:29.100094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:29.112515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-52c666be-6100-443c-9f7e-6a3c00699ce8 req-b46d8e7e-b627-4057-be1f-7342b0aadfca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076438 Jun 16 17:41:29.113739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 450/889] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:29.168914 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:29.181974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:29.192658 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6528d50a-9d06-43dc-bc9b-f70ce17bc68a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 1.328903 Jun 16 17:41:29.193960 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 440/890] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:27 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:30.052128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b048550-5376-467e-89a9-b9799fcb4cc8 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Action: 'create', calling method: .version_select at 0x7f84aa326550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1862133657", "metadata": {"Type": "work"}}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:30.057519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:30.058431 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:30.073124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:30.074007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:30.075372 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:30.076032 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b048550-5376-467e-89a9-b9799fcb4cc8 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 122 Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:30.085366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1862133657", "metadata": {"Type": "work"}}} Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:41:30.087983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1862133657', 'metadata': {'Type': 'work'}}}} Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.089854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:41:30.092046 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:41:30.093835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 17:41:30.093835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.096622 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b048550-5376-467e-89a9-b9799fcb4cc8 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.098465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7b048550-5376-467e-89a9-b9799fcb4cc8 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.365501 Jun 16 17:41:30.099791 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 451/891] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 17:41:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:41:30.110734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cb4c9826-720d-418d-b26d-68f9e434c85c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Action: 'create', calling method: .version_select at 0x7f84aa371e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1035875186", "metadata": {"Type": "work"}}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cb4c9826-720d-418d-b26d-68f9e434c85c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 120 Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:30.118553 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1035875186", "metadata": {"Type": "work"}}} Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:41:30.120322 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1035875186', 'metadata': {'Type': 'work'}}}} Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi '0' Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.127887 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:41:30.130521 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:41:30.132443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 17:41:30.132443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.132443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cb4c9826-720d-418d-b26d-68f9e434c85c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.132443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cb4c9826-720d-418d-b26d-68f9e434c85c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014205 Jun 16 17:41:30.132443 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 452/892] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 17:41:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:41:30.138287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7c761d18-2c8b-4453-81ae-d8dd0a76cddc tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Action: 'create', calling method: .version_select at 0x7f84aa2943a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1608182647", "metadata": {"Type": "work"}}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7c761d18-2c8b-4453-81ae-d8dd0a76cddc tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 119 Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:30.143949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1608182647", "metadata": {"Type": "work"}}} Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:41:30.146153 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1608182647', 'metadata': {'Type': 'work'}}}} Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise error Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi '' Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.147148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 17:41:30.148765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 17:41:30.150194 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 17:41:30.150194 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.150194 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7c761d18-2c8b-4453-81ae-d8dd0a76cddc tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.151463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7c761d18-2c8b-4453-81ae-d8dd0a76cddc tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021770 Jun 16 17:41:30.156414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 453/893] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jun 16 17:41:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:41:30.187215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e9480ce5-a5a4-42b7-842c-4b1cc56b375c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Calling method '.version_select at 0x7f84aa326dc0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:30.280666 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-e9480ce5-a5a4-42b7-842c-4b1cc56b375c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] HTTP exception thrown: Volume tempest-invalid-1527189361 could not be found. Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e9480ce5-a5a4-42b7-842c-4b1cc56b375c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1527189361 HTTP/1.1 Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:41:30.284620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Volume tempest-invalid-1527189361 could not be found. Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'tempest-invalid-1527189361'} Jun 16 17:41:30.287351 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1527189361 could not be found. (HTTP 404) (Request-ID: req-ece68d75-2567-4d0e-ae0a-4b8ad16d44a6) Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.288896 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:30.291423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1527189361 could not be found. Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:30.296846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1527189361 could not be found. Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1527189361 could not be found. Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.299482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e9480ce5-a5a4-42b7-842c-4b1cc56b375c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 404 to user: Volume tempest-invalid-1527189361 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.302091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e9480ce5-a5a4-42b7-842c-4b1cc56b375c tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1527189361" status: 404 len: 99 microversion: 2.1 time: 0.131362 Jun 16 17:41:30.304731 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 454/894] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jun 16 17:41:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1527189361 => generated 99 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 17:41:30.343651 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:30.344944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:30.365411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:30.365868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:30.366659 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:30.367109 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:30.425730 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:30.435323 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cfb5bd8b-46aa-475f-8d2a-956a445b7fe3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.386675 Jun 16 17:41:30.458921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 441/895] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:30 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:41:30.470938 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-98eaa79f-1baa-4f2c-9f7a-f3514232128a tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004018 Jun 16 17:41:30.471893 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 442/896] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jun 16 17:41:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 17:41:30.493472 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f42d1685-8a8f-4d0b-81e2-46f5c7b98b52 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005542 Jun 16 17:41:30.505050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 443/897] 10.222.0.40 () {58 vars in 1136 bytes} [Thu Jun 16 17:41:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 17:41:30.529832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cbe905ba-ca20-4326-a147-a959b600fd51 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Calling method '.version_select at 0x7f84aa307c10>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:30.602650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-cbe905ba-ca20-4326-a147-a959b600fd51 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] HTTP exception thrown: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cbe905ba-ca20-4326-a147-a959b600fd51 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/os-volumes/c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 HTTP/1.1 Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:30.606543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'c1e44f9b-05ce-4db1-ac6b-21e80466f2f4'} Jun 16 17:41:30.608877 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. (HTTP 404) (Request-ID: req-8e67e9db-7b92-40ee-bb25-8d0f0831e59d) Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.610174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 17:41:30.612277 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 17:41:30.614321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. Jun 16 17:41:30.615845 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.624499 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cbe905ba-ca20-4326-a147-a959b600fd51 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 404 to user: Volume c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.629688 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cbe905ba-ca20-4326-a147-a959b600fd51 tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/c1e44f9b-05ce-4db1-ac6b-21e80466f2f4" status: 404 len: 109 microversion: 2.1 time: 0.114259 Jun 16 17:41:30.636600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 444/898] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jun 16 17:41:30 2022] DELETE /compute/v2.1/os-volumes/c1e44f9b-05ce-4db1-ac6b-21e80466f2f4 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:30.649649 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56201ea4-2326-4b39-adfb-b5982d2f94ac tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Calling method '.version_select at 0x7f84aa477c10>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:30.726480 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-56201ea4-2326-4b39-adfb-b5982d2f94ac tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] HTTP exception thrown: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56201ea4-2326-4b39-adfb-b5982d2f94ac tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Request method failure captured: Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/os-volumes/6a736661-a335-494f-ad03-1b58fb3dcc3c HTTP/1.1 Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2tJapsyVUsXMy4SVLULM5e7DMAipwXHC-dne7l2JG0yNULGCS2wpNi5saDsHLpQKPWpwQNNCSEVWmatb-UmkTWKXkOsgsalsRO_FVSIV8hdSnWTYEOLD0GFyDJyZjEYPPie_6auzpFLik9QgXmJlUnMNfqXGlBaToM220NiiWfGUsU Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:41:30.733855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5a40e370a76f4649a03a5cd2e0bf8abd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5a40e370a76f4649a03a5cd2e0bf8abd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5a40e370a76f4649a03a5cd2e0bf8abd"}]}] Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 5a40e370a76f4649a03a5cd2e0bf8abd Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesNegativeTest-359413431 Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: f1cb09e72e6b45308ca64d5d2140d17f Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesNegativeTest-359413431-project Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '6a736661-a335-494f-ad03-1b58fb3dcc3c'} Jun 16 17:41:30.739625 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. (HTTP 404) (Request-ID: req-14e587eb-6e31-457e-9096-6325aaa44311) Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.742979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 17:41:30.751184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 17:41:30.754788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:41:30.757442 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-56201ea4-2326-4b39-adfb-b5982d2f94ac tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] Returning 404 to user: Volume 6a736661-a335-494f-ad03-1b58fb3dcc3c could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:41:30.760908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-56201ea4-2326-4b39-adfb-b5982d2f94ac tempest-VolumesNegativeTest-359413431 tempest-VolumesNegativeTest-359413431-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6a736661-a335-494f-ad03-1b58fb3dcc3c" status: 404 len: 109 microversion: 2.1 time: 0.112830 Jun 16 17:41:30.762347 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 445/899] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jun 16 17:41:30 2022] GET /compute/v2.1/os-volumes/6a736661-a335-494f-ad03-1b58fb3dcc3c => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:41:30.823441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:30.851155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:30.865664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:30.873531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-05a4d32f-41b3-4af6-9c2b-17fe339192a4 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.551202 Jun 16 17:41:30.877499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 455/900] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:30 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:31.482588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:31.488104 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:31.497824 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=34 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:31.512422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:31.513406 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:31.514748 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:31.515682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:31.917580 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:31.920294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:31.930671 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:31.931799 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:31.932864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:31.933644 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:31.980375 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:32.004388 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c8483be3-fdcd-49b7-ada7-76e0b5c43f2e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.539588 Jun 16 17:41:32.013334 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 446/901] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:31 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:41:32.358363 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:32.381117 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=10 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:32.486332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:32.505081 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:32.507805 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:32.510728 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ec02c0b0-1f18-450d-a392-f20adf7dae2e tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.605144 Jun 16 17:41:32.511877 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 456/902] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:31 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:41:33.039928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:33.042408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:33.059315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:33.068387 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:33.069553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:33.070683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:33.074439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:33.341759 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:33.352947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c36587c7-6087-4d19-a7c8-95a1c899056e tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.323434 Jun 16 17:41:33.367513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 447/903] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:33 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:33.534945 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:33.536350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:33.553261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:33.561554 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:33.566013 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:33.569937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:33.570739 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:33.870531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:33.887343 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:33.889775 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:33.891520 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a9f13acd-b85b-4c7b-821a-32fcc9c40049 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.362998 Jun 16 17:41:33.905189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 457/904] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:33 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:34.377407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:34.378600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:34.391253 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:34.392714 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:34.394439 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:34.395697 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:34.723476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:34.736035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-255de216-c951-4902-86b2-5a0aafb75cf1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.364120 Jun 16 17:41:34.736842 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 448/905] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:34 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:34.923481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:34.925600 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:34.937366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:34.938078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:34.939883 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:34.940830 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:35.144938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:35.157862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:35.160783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:35.162524 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1b42265d-b1a2-4151-b7d9-a163a4a5d098 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1731 microversion: 2.20 time: 0.248749 Jun 16 17:41:35.184208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 458/906] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:34 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:35.764839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:35.765743 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:35.775535 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:35.776066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:35.777326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:35.777821 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:35.955135 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:35.967776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-22f08da6-461e-430b-a21c-d3b0b2b064e4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.214848 Jun 16 17:41:35.969011 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 449/907] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:35 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:36.195756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:36.196523 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:36.207842 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:36.208137 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:36.208807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:36.209137 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:36.448590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:36.459106 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:36.460788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:36.462240 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-242bc2eb-945f-4882-901f-fcc7ed794ee2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1718 microversion: 2.20 time: 0.271148 Jun 16 17:41:36.462809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 459/908] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:41:36 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1718 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:41:36.991795 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:36.992460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:36.999462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:36.999937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:37.000736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:37.001802 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:37.269373 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:37.281680 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e9e72031-0310-4034-938f-f7a684424802 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.297270 Jun 16 17:41:37.282878 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 450/909] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:36 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:38.301098 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:38.301864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:38.309068 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:38.309655 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:38.310550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:38.311195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:38.522916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:38.537586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9cae7f28-d0e9-4195-944a-3f72b3e1108d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.240939 Jun 16 17:41:38.538304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 460/910] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:38 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:41:39.560782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:39.561621 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:39.570617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:39.571315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:39.572377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:39.573261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:39.742798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:39.754508 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d5e88190-d458-479f-9257-897afa777a5c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.198489 Jun 16 17:41:39.755187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 451/911] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:39 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:40.020550 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-ca724fa7-aa25-46e7-89b0-0471a08ac6d9 req-a787a0e7-fa56-4a34-a72f-5f926959c382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "name": "network-vif-plugged", "status": "completed", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:40.031847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-ca724fa7-aa25-46e7-89b0-0471a08ac6d9 req-a787a0e7-fa56-4a34-a72f-5f926959c382 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:40.032971 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-ca724fa7-aa25-46e7-89b0-0471a08ac6d9 req-a787a0e7-fa56-4a34-a72f-5f926959c382 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:40.051175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-ca724fa7-aa25-46e7-89b0-0471a08ac6d9 req-a787a0e7-fa56-4a34-a72f-5f926959c382 service nova] Creating event network-vif-plugged:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:41:40.058829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-ca724fa7-aa25-46e7-89b0-0471a08ac6d9 req-a787a0e7-fa56-4a34-a72f-5f926959c382 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048915 Jun 16 17:41:40.060226 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 461/912] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:40.778401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:40.779098 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:40.786837 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:40.787284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:40.788070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:40.788504 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:40.805879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=100 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:40.956558 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:40.964376 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f305979f-784b-4d37-8d33-21913f8a8e3d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1358 microversion: 2.1 time: 0.192570 Jun 16 17:41:40.965050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 452/913] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:40 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:41.984242 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:41.985281 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:41.998706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:41.998706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:41.998706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:41.998706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.135245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:42.142923 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a66f1792-46b0-4e37-bff4-b66a79643240 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1548 microversion: 2.1 time: 0.163745 Jun 16 17:41:42.143489 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 462/914] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:41 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:42.159322 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:42.159932 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:42.166393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.166836 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.167593 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.168022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.298987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:42.306704 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e896ee5f-24d8-4557-91d6-ad7e821229b4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1548 microversion: 2.1 time: 0.151393 Jun 16 17:41:42.307298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 453/915] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:42 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:42.322403 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:42.325878 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:42.326640 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Searching by: {'deleted': False, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc'} {{(pid=124161) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 17:41:42.335246 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.335701 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.336496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.336932 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.426656 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.multi_cell_list [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124161) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 17:41:42.524414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-efe8deaf-4ba1-47c7-95c2-5777f93714e9 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205885 Jun 16 17:41:42.525007 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 463/916] 10.222.0.40 () {58 vars in 1124 bytes} [Thu Jun 16 17:41:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:42.535268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:42.535881 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:42.541909 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.542354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.543106 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:42.543537 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:42.678543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:42.685897 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-723446c4-fe02-448e-b7a5-7c8af56544dc tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1548 microversion: 2.1 time: 0.154629 Jun 16 17:41:42.686464 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 454/917] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:42 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:44.227294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a22cd843-69ff-44cb-b7b1-59efa042cf9d"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:44.228365 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:44.236263 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:44.237016 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:44.238112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:44.238276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:44.495485 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8836b5b7-44e1-4671-a9c6-5de885e1e446 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272046 Jun 16 17:41:44.501259 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 464/918] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:41:44 2022] POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:52.129460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:52.130077 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:52.136786 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:52.137125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:52.137918 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:52.138352 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:52.280613 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:52.289764 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3e7ca210-0551-4565-9f50-2edde9042bec tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1594 microversion: 2.1 time: 0.165018 Jun 16 17:41:52.290380 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 455/919] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:52 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:54.759224 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:54.760252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=15 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:54.761198 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:41:54.774008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-3ee58d76-33c9-42d7-92cb-928a94babb47 req-390cdf6e-3d53-4347-9f2b-01fd5bf82008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:54.795195 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-3ee58d76-33c9-42d7-92cb-928a94babb47 req-390cdf6e-3d53-4347-9f2b-01fd5bf82008 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:54.795625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-3ee58d76-33c9-42d7-92cb-928a94babb47 req-390cdf6e-3d53-4347-9f2b-01fd5bf82008 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:54.809884 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-3ee58d76-33c9-42d7-92cb-928a94babb47 req-390cdf6e-3d53-4347-9f2b-01fd5bf82008 service nova] Creating event network-changed:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:41:54.816333 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-3ee58d76-33c9-42d7-92cb-928a94babb47 req-390cdf6e-3d53-4347-9f2b-01fd5bf82008 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058399 Jun 16 17:41:54.817579 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 465/920] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:55.942596 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2017246573"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:55.943311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:55.950169 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:55.950612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:55.951379 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:55.951807 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:56.091420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.network.security_group_api [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Adding security group 67e9b173-e555-499a-87e1-4b1ac2b90b4e to port 847dc5cf-0312-4fdf-b298-3e5d0e5ddbca Jun 16 17:41:56.478265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e6fdca01-8b77-49cb-a22c-44bd4eacbeb6 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action" status: 202 len: 0 microversion: 2.1 time: 0.539746 Jun 16 17:41:56.478990 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 456/921] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:41:55 2022] POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:41:56.489387 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:56.490096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:56.497571 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:56.498019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:56.498801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:56.499291 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:56.668505 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:56.677477 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-0d092ad7-9e00-4dba-8754-f304bda66a05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1641 microversion: 2.1 time: 0.193455 Jun 16 17:41:56.678053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 466/922] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:56 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1641 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:56.832235 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-b4eef838-18a7-4960-b988-387cff20f46c req-f99814cc-3161-48b2-b0e7-e68fadaf1c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:56.840265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b4eef838-18a7-4960-b988-387cff20f46c req-f99814cc-3161-48b2-b0e7-e68fadaf1c1e service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:56.840732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-b4eef838-18a7-4960-b988-387cff20f46c req-f99814cc-3161-48b2-b0e7-e68fadaf1c1e service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:56.851879 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-b4eef838-18a7-4960-b988-387cff20f46c req-f99814cc-3161-48b2-b0e7-e68fadaf1c1e service nova] Creating event network-changed:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:41:56.857640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-b4eef838-18a7-4960-b988-387cff20f46c req-f99814cc-3161-48b2-b0e7-e68fadaf1c1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029553 Jun 16 17:41:56.858244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 457/923] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:41:57.751388 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-196824840", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "networks": [{"uuid": "c46d647a-b877-4cb5-9d41-f29712e06919"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:41:57.808331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] validate_networks() for [('c46d647a-b877-4cb5-9d41-f29712e06919', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:41:58.179454 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:41:58.179882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:41:58.180358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:41:58.180770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:41:58.181211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:41:58.190893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:58.191344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:58.192140 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:58.192574 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:58.210031 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Getting quotas for project 554c281060a446ed9b2d02bad7b8ec1d. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:41:58.214021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Getting quotas for user 9de9e460242c4a02ad28af485ad851e5 and project 554c281060a446ed9b2d02bad7b8ec1d. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:41:58.225844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:41:58.228102 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:41:58.276589 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4b1e611c-c5ea-4bc6-85f3-b2e488a02fe6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529986 Jun 16 17:41:58.277270 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 467/924] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:41:58.288964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-19b3499d-cdfd-4fa1-9069-df7872d2a4ea tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:58.289765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-19b3499d-cdfd-4fa1-9069-df7872d2a4ea tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:58.348248 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-19b3499d-cdfd-4fa1-9069-df7872d2a4ea tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:58.355081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-19b3499d-cdfd-4fa1-9069-df7872d2a4ea tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1218 microversion: 2.1 time: 0.070381 Jun 16 17:41:58.356370 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 458/925] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:58 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:41:59.375203 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:41:59.376215 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:41:59.385790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:59.388419 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:59.389418 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:41:59.390269 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:41:59.463018 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:41:59.475809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eccf5a22-59d5-439f-885b-74de1c375073 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1288 microversion: 2.1 time: 0.105170 Jun 16 17:41:59.477006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 468/926] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:41:59 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:00.298176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:00.299674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:00.307617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.308488 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.310060 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.315616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-d1e06ad6-8681-4a02-8297-6ca0b6ff850c req-03acbdcf-70c0-4718-9878-8e1dc9a1c57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:00.320712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.324577 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-d1e06ad6-8681-4a02-8297-6ca0b6ff850c req-03acbdcf-70c0-4718-9878-8e1dc9a1c57f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.330832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-d1e06ad6-8681-4a02-8297-6ca0b6ff850c req-03acbdcf-70c0-4718-9878-8e1dc9a1c57f service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.362199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-d1e06ad6-8681-4a02-8297-6ca0b6ff850c req-03acbdcf-70c0-4718-9878-8e1dc9a1c57f service nova] Creating event network-changed:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:42:00.373958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-d1e06ad6-8681-4a02-8297-6ca0b6ff850c req-03acbdcf-70c0-4718-9878-8e1dc9a1c57f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062083 Jun 16 17:42:00.374725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:42:00.375597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 469/927] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:42:00.492725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ebd488fa-e27c-4437-bb7b-3d5c32b5b048 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 204 len: 0 microversion: 2.1 time: 0.198417 Jun 16 17:42:00.494408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 459/928] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:42:00 2022] DELETE /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:42:00.495861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:00.496664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:00.509308 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:00.510681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:00.512061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.512658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.513561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.514283 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.519564 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.520997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.522355 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:00.524589 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:00.778041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:00.788830 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-26356bbb-5baf-4a3a-847d-49376e6aafc8 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.289930 Jun 16 17:42:00.789540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 460/929] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:00 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:00.791803 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:00.800792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8699a1a9-c5e3-41e4-aa0a-bc468cb49c36 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.309520 Jun 16 17:42:00.801416 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 470/930] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:00 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:01.807354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:01.807985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:01.810358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:01.817512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:01.817952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:01.818311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:01.818761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:01.819105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:01.819214 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:01.826142 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:01.826582 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:01.827350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:01.828384 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:02.057205 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:02.064964 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:02.066222 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ce093498-9849-4db3-97a5-cf167374798f tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.262694 Jun 16 17:42:02.066819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 461/931] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:01 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:02.072966 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-6381cb55-3b98-45d3-a813-e16f70ebf3a7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.258596 Jun 16 17:42:02.073638 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 471/932] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:01 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:03.085117 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:03.085874 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:03.090634 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:03.091256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:03.092390 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:03.092839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:03.094186 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:03.094785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:03.098613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:03.099071 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:03.099853 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:03.100297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:03.300839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:03.301835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:03.309687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-05933d74-20d1-4eac-aa00-f058fea0e22c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.222691 Jun 16 17:42:03.310923 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 472/933] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:03 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:03.313435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1d4357da-ed98-42fe-951a-8878e22ab5bb tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.232153 Jun 16 17:42:03.314016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 462/934] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:03 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:04.335692 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:04.336345 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:04.350276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:04.351183 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:04.352211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:04.352847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:04.552382 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:04.553196 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:04.564497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:04.565257 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:04.566207 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:04.569572 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:04.754950 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:04.768710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a79f4d4d-bdc3-44b1-8e97-d1e2902dfb16 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.433143 Jun 16 17:42:04.769815 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 473/935] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:04 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:04.932724 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-f18bb4c9-660b-4119-a4b3-33ab8fe14267 req-ac079702-7685-4e02-85a7-7fce78861001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1c7182-f0ad-44cd-b16f-427e775c2d82", "tag": "f6ceb8b6-33ce-4014-9702-8fb437b60ab0"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:04.971770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-f18bb4c9-660b-4119-a4b3-33ab8fe14267 req-ac079702-7685-4e02-85a7-7fce78861001 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:04.972408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-f18bb4c9-660b-4119-a4b3-33ab8fe14267 req-ac079702-7685-4e02-85a7-7fce78861001 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:04.986189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-f18bb4c9-660b-4119-a4b3-33ab8fe14267 req-ac079702-7685-4e02-85a7-7fce78861001 service nova] Creating event network-changed:f6ceb8b6-33ce-4014-9702-8fb437b60ab0 for instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 on hv-cinder-83754 Jun 16 17:42:04.992530 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-f18bb4c9-660b-4119-a4b3-33ab8fe14267 req-ac079702-7685-4e02-85a7-7fce78861001 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064522 Jun 16 17:42:04.997710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 474/936] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:05.243832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:05.252906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1470d9dc-fa7c-405a-8cea-423f0cdf2e59 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1569 microversion: 2.1 time: 0.921755 Jun 16 17:42:05.253733 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 463/937] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:04 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1569 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:05.786980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:05.787707 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:05.794711 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:05.795164 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:05.795946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:05.797317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:05.831356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-d91cadb7-32dc-4159-a67e-fb5b441a724a req-3743efed-d8b5-4077-b25a-6d01a27c8391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf54c7b6-dc97-4196-bab4-a7698f785a20", "name": "network-vif-deleted", "tag": "e9883d3b-f3e0-401d-bbc0-e2d284e3f19d"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:05.842310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-d91cadb7-32dc-4159-a67e-fb5b441a724a req-3743efed-d8b5-4077-b25a-6d01a27c8391 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:05.842750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-d91cadb7-32dc-4159-a67e-fb5b441a724a req-3743efed-d8b5-4077-b25a-6d01a27c8391 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:05.855533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-d91cadb7-32dc-4159-a67e-fb5b441a724a req-3743efed-d8b5-4077-b25a-6d01a27c8391 service nova] Creating event network-vif-deleted:e9883d3b-f3e0-401d-bbc0-e2d284e3f19d for instance bf54c7b6-dc97-4196-bab4-a7698f785a20 on hv-cinder-83754 Jun 16 17:42:05.862588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-d91cadb7-32dc-4159-a67e-fb5b441a724a req-3743efed-d8b5-4077-b25a-6d01a27c8391 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 Jun 16 17:42:05.863550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 464/938] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:42:05.958469 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:05.966152 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5c22cd50-e4e7-498c-8e56-d3f928e29fb1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.183409 Jun 16 17:42:05.966821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 475/939] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:05 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:06.271854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:06.272696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:06.279484 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:06.279939 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:06.281480 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:06.282191 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:06.353462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:06.361711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-017611c8-cae5-4d49-9bfe-b8ce2d76c0f1 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1219 microversion: 2.1 time: 0.094176 Jun 16 17:42:06.362283 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 465/940] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:06 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:06.989429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:06.991225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:07.004492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:07.005131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:07.006408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:07.007447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:07.235180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:07.256736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-97a2945f-b608-49d6-8079-ecebc35eb6ba tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.275449 Jun 16 17:42:07.257801 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 476/941] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:06 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:07.385546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:07.387498 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:07.408110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:07.408976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:07.409909 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:07.410349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:07.461635 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:07.462202 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:07.462841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lazy-loading 'fault' on Instance uuid bf54c7b6-dc97-4196-bab4-a7698f785a20 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:42:07.541122 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41334c5088e4f4990637fd7e2964999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35fdc8ef703e43f1a730a868721c4a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:07.550158 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aa0e7084-e6b0-4940-af42-2dfd4b6aee0d tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 200 len: 1178 microversion: 2.1 time: 0.174365 Jun 16 17:42:07.551897 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 466/942] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:07 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 1178 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:08.282218 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:08.282881 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:08.285264 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:08.285923 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=6 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:08.291730 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:08.292180 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:08.293088 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:08.293717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:08.434136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:08.443023 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-55f7d2e0-4b64-4ac9-8c08-babdfd77161f tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.164626 Jun 16 17:42:08.443611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 477/943] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:08 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:08.569436 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:08.570180 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] [instance: bf54c7b6-dc97-4196-bab4-a7698f785a20] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:08.572266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:08.579336 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:08.579750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:08.580538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:08.580974 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:08.595686 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] HTTP exception thrown: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Request method failure captured: Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 HTTP/1.1 Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2o1NscQyuNUCJ3NyxhI9yYMVQwn8Lmajpd0ixJKIOtr5TTFmjQKB-XDO4KVmcWpUU_8Z4Kg8-eUWgB0p33WT1_-wk-C3gSi-kG1QP_XLHfzm76KL15RHZUViN9H4XBoNoABEkELObynyrJhGtSLkchEyMRUfOhUA0x5FleKbPp0z0o Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 35fdc8ef703e43f1a730a868721c4a2d Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-TestShelveInstance-2129903188 Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:42:08.597456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/35fdc8ef703e43f1a730a868721c4a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/35fdc8ef703e43f1a730a868721c4a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_35fdc8ef703e43f1a730a868721c4a2d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/35fdc8ef703e43f1a730a868721c4a2d"}]}] Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-TestShelveInstance-2129903188 Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 35fdc8ef703e43f1a730a868721c4a2d Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-TestShelveInstance-2129903188 Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-TestShelveInstance-2129903188-project Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: b41334c5088e4f4990637fd7e2964999 Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-TestShelveInstance-2129903188-project Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. Jun 16 17:42:08.599234 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'bf54c7b6-dc97-4196-bab4-a7698f785a20'} Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:08.600377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. Jun 16 17:42:08.602031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:08.603736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Returning 404 to user: Instance bf54c7b6-dc97-4196-bab4-a7698f785a20 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:08.603736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a9147642-5d60-4393-af10-09b303ead4f2 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20" status: 404 len: 111 microversion: 2.1 time: 0.033537 Jun 16 17:42:08.603736 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 467/944] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:08 2022] GET /compute/v2.1/servers/bf54c7b6-dc97-4196-bab4-a7698f785a20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:42:08.802889 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-fda76f1b-3f81-4fb1-8702-72b33bc08706 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] Calling method '.version_select at 0x7f84aa46a550>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:08.843074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-fda76f1b-3f81-4fb1-8702-72b33bc08706 tempest-TestShelveInstance-2129903188 tempest-TestShelveInstance-2129903188-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-493824270" status: 202 len: 0 microversion: 2.1 time: 0.047384 Jun 16 17:42:08.846399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 478/945] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jun 16 17:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-493824270 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:42:09.460020 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:09.460460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:09.466950 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:09.467631 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:09.469244 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:09.469948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:09.703681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:09.712092 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7ad05f25-3684-4994-b4da-284bd45d9d92 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.256012 Jun 16 17:42:09.712947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 468/946] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:09 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:10.729572 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:10.730981 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:10.737618 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:10.738309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:10.739531 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:10.740004 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:10.928284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:10.951350 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1a680c21-a99d-4e51-b160-771267670a91 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.225704 Jun 16 17:42:10.952810 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 479/947] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:10 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:11.992695 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:11.995475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:12.005813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:12.006345 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:12.007198 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:12.007864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:12.033694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:12.236803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:12.246261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f89efb8a-727c-4d6a-a1ea-42ee04dc394c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.280239 Jun 16 17:42:12.247174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 469/948] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:11 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:12.623152 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-7150fdde-642a-4ad6-81e0-da5dd5865017 req-c179765b-4a09-4a2f-93ad-b8ba7a179002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1c7182-f0ad-44cd-b16f-427e775c2d82", "name": "network-vif-plugged", "status": "completed", "tag": "f6ceb8b6-33ce-4014-9702-8fb437b60ab0"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:12.637876 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7150fdde-642a-4ad6-81e0-da5dd5865017 req-c179765b-4a09-4a2f-93ad-b8ba7a179002 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:12.640972 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7150fdde-642a-4ad6-81e0-da5dd5865017 req-c179765b-4a09-4a2f-93ad-b8ba7a179002 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:12.676189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-7150fdde-642a-4ad6-81e0-da5dd5865017 req-c179765b-4a09-4a2f-93ad-b8ba7a179002 service nova] Creating event network-vif-plugged:f6ceb8b6-33ce-4014-9702-8fb437b60ab0 for instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 on hv-cinder-83754 Jun 16 17:42:12.682057 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-7150fdde-642a-4ad6-81e0-da5dd5865017 req-c179765b-4a09-4a2f-93ad-b8ba7a179002 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063968 Jun 16 17:42:12.683212 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 480/949] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:13.263832 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:13.265314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:13.272305 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:13.273021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:13.273989 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:13.274709 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:13.437820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:13.447140 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f98569ee-06a3-428f-be8a-d7cc5d1a1e80 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.187112 Jun 16 17:42:13.447934 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 470/950] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:13 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:14.466543 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:14.467251 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:14.474700 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:14.475159 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:14.475948 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:14.477080 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:14.655607 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:14.666652 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-512de467-1077-4c19-afe6-9902266e0087 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.204888 Jun 16 17:42:14.667918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 481/951] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:14 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:15.695100 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:15.698949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:15.716241 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:15.718426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:15.721120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:15.722050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:15.894420 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:15.904906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0b3b6509-a2f1-4da6-b3fa-acc54590dc8d tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.219812 Jun 16 17:42:15.905921 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 471/952] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:15 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:16.928912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:16.930483 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:16.941955 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:16.942407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:16.943188 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:16.943623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:17.131225 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:17.140266 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-27ee52b4-8029-4ecc-bffb-e129311d12eb tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1318 microversion: 2.1 time: 0.218687 Jun 16 17:42:17.141303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 482/953] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:16 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:18.160150 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:18.161892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:18.173627 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:18.174912 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:18.176087 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:18.176947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:18.410013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:18.420899 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fc494dd9-9910-4ef9-87c0-a2414579aea6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1506 microversion: 2.1 time: 0.266515 Jun 16 17:42:18.421783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 472/954] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:18 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:18.934227 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:18.935314 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:18.943601 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:18.944045 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:18.945235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:18.946014 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:18.979952 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-28c25184-f335-47c1-aa67-271fe8f24529 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051571 Jun 16 17:42:18.980535 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 483/955] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jun 16 17:42:18 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:19.050391 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:19.050923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:19.057978 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:19.058788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:19.059940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:19.060460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:19.088766 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:42:19.205681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3d21f83c-fffc-43f5-925f-8e76eceeda0a tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 204 len: 0 microversion: 2.20 time: 0.158525 Jun 16 17:42:19.206843 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 473/956] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 17:42:19 2022] DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 17:42:19.218796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:19.219094 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:19.225481 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:19.225933 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:19.226998 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:19.227447 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:19.402997 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:19.414625 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:19.416173 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:19.417636 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-efe2b6a1-7ee7-4973-8efe-64d4cba07485 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.204924 Jun 16 17:42:19.418244 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 484/957] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:19 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:42:20.444351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:20.445957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:20.456569 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:20.457059 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:20.457948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:20.458429 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:20.618397 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:20.628611 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:20.631396 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:20.633376 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5ba0d5e0-48d0-45b2-a165-358d2e94360d tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.193805 Jun 16 17:42:20.634310 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 474/958] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:20 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:42:21.656275 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:21.657901 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:21.666408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:21.667256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:21.668551 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:21.669076 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:21.769165 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2054930717", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489756062", "security_groups": [{"name": "tempest-secgroup-smoke-266615842"}], "block_device_mapping_v2": [{"uuid": "6394ba58-c9e9-4a73-9eb5-37e204d34d39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6e803cc9-885b-4092-b21c-ed0c8b49c26c"}]}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:22.026784 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:22.030783 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:22.032908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] validate_networks() for [('6e803cc9-885b-4092-b21c-ed0c8b49c26c', None, None, None, None, None)] {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:42:22.038807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:22.040613 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:22.041873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-71a6c158-1e8c-434e-976a-a5ad29419959 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1724 microversion: 2.20 time: 0.390056 Jun 16 17:42:22.043894 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 485/959] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:21 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:42:23.012336 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:42:23.012940 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:42:23.013575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:42:23.014477 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:42:23.015408 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:42:23.053434 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:23.053954 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:23.054790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:23.055256 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:23.063426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:23.070590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:23.076499 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:42:23.079311 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:23.080407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:23.081720 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:23.082353 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:23.082788 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Getting quotas for user faf0a0102da24cedaedd0c67273e275b and project 314e9434e0ec4c1f9e8d6037143f5ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:42:23.168401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:42:23.172937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6394ba58-c9e9-4a73-9eb5-37e204d34d39',volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:42:23.269513 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:23.298258 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:23.303444 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fbaf6d894e64f19bf041e7be20a6242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fb554e0cf14c7ab3a9f538273c289e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:23.305206 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c5bb8318-63ed-4d76-8bbc-f3db9ee99b03 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 200 len: 1657 microversion: 2.20 time: 0.245949 Jun 16 17:42:23.319114 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 486/960] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:23 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 1657 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:42:23.374428 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-a4f9379c-9aa0-4f6d-a921-92ce1fbcceba req-103c7bca-20db-4afd-9aa9-4ac4705025c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3be83a-9759-422f-9cd1-5a5d1c631ace", "name": "network-vif-deleted", "tag": "a57fbaeb-135f-4864-997b-23904c802e78"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:23.398990 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a4f9379c-9aa0-4f6d-a921-92ce1fbcceba req-103c7bca-20db-4afd-9aa9-4ac4705025c4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:23.399778 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-a4f9379c-9aa0-4f6d-a921-92ce1fbcceba req-103c7bca-20db-4afd-9aa9-4ac4705025c4 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:23.425620 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-a4f9379c-9aa0-4f6d-a921-92ce1fbcceba req-103c7bca-20db-4afd-9aa9-4ac4705025c4 service nova] Creating event network-vif-deleted:a57fbaeb-135f-4864-997b-23904c802e78 for instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace on hv-cinder-83754 Jun 16 17:42:23.429009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-dd8a4c2d-fe6c-440c-809f-17c959c2252e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.664366 Jun 16 17:42:23.429767 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 475/961] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:42:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:42:23.435804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-a4f9379c-9aa0-4f6d-a921-92ce1fbcceba req-103c7bca-20db-4afd-9aa9-4ac4705025c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070050 Jun 16 17:42:23.438175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 487/962] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:23.444618 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d2a49460-feb2-44fd-808f-b5e42258c7f1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:23.445602 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d2a49460-feb2-44fd-808f-b5e42258c7f1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:23.546692 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d2a49460-feb2-44fd-808f-b5e42258c7f1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:23.558964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d2a49460-feb2-44fd-808f-b5e42258c7f1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1094 microversion: 2.1 time: 0.119429 Jun 16 17:42:23.561238 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 476/963] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:23 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:24.331547 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:24.333095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:24.342383 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:24.343465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:24.346007 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:24.346463 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:24.372906 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace HTTP/1.1 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:42:24.374658 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:24.376944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '9e3be83a-9759-422f-9cd1-5a5d1c631ace'} Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:24.377824 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:24.380061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:24.383118 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:24.383118 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-24b02e5b-d948-4399-90de-cca26918fde8 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 404 len: 111 microversion: 2.20 time: 0.053604 Jun 16 17:42:24.383118 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 488/964] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:24 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:42:24.387230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2d133ce3-7f5b-40f0-a855-46b8971372ff tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '.version_select at 0x7f84aa571af0>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:24.413498 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2d133ce3-7f5b-40f0-a855-46b8971372ff tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647531770" status: 204 len: 0 microversion: 2.20 time: 0.030591 Jun 16 17:42:24.414454 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 477/965] 10.222.0.40 () {60 vars in 1258 bytes} [Thu Jun 16 17:42:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647531770 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 17:42:24.592795 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:24.593800 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:24.601438 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:24.601847 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:24.602715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:24.603135 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:24.755231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:24.780808 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-14994faf-39cf-4749-9296-af8c5767ae6e tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1136 microversion: 2.1 time: 0.198020 Jun 16 17:42:24.783089 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 489/966] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:24 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1136 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:25.801823 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:25.802475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:25.808713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:25.809203 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:25.809969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:25.810411 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:25.926279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:25.935951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-573eab78-7ff1-4be8-8157-c1cc53cdf0f6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1210 microversion: 2.1 time: 0.139440 Jun 16 17:42:25.936928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 478/967] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:25 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:26.737576 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:26.738175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:26.740704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:26.747088 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.747636 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:26.748464 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.748988 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:26.768332 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace HTTP/1.1 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:42:26.770548 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.772654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '9e3be83a-9759-422f-9cd1-5a5d1c631ace'} Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:26.780804 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.782516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.784304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:26.784304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a747e141-0075-40c7-9749-8218b92ac6a6 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 404 len: 111 microversion: 2.20 time: 0.040263 Jun 16 17:42:26.784304 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 490/968] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 17:42:26 2022] DELETE /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:42:26.784661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:26.784661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: 9e3be83a-9759-422f-9cd1-5a5d1c631ace] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:26.789710 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.790176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:26.791005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.791474 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:26.809486 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace HTTP/1.1 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:42:26.810666 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.814947 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '9e3be83a-9759-422f-9cd1-5a5d1c631ace'} Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:26.816369 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. Jun 16 17:42:26.819597 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:26.821031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance 9e3be83a-9759-422f-9cd1-5a5d1c631ace could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:26.821031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4e3984ee-59c7-4f28-9189-eebd42565712 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace" status: 404 len: 111 microversion: 2.20 time: 0.035078 Jun 16 17:42:26.821031 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 479/969] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:26 2022] GET /compute/v2.1/servers/9e3be83a-9759-422f-9cd1-5a5d1c631ace => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:42:26.964777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:26.966319 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:26.976041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.977015 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:26.978237 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:26.979023 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:27.229654 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:27.252807 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-b1c893c2-a25d-4849-aa36-5a17da84e1b5 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.296734 Jun 16 17:42:27.254113 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 491/970] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:26 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:27.342070 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-2b71753c-c463-4d24-a50d-241928a6609e req-8091a343-61ad-4dde-adb0-16626d03070d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880f65f6-c574-48a5-8868-6979fc8a834a", "tag": "6c5ca3a5-989e-4775-9839-4980ee405ae9"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:27.359313 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2b71753c-c463-4d24-a50d-241928a6609e req-8091a343-61ad-4dde-adb0-16626d03070d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:27.359517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2b71753c-c463-4d24-a50d-241928a6609e req-8091a343-61ad-4dde-adb0-16626d03070d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:27.390341 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-2b71753c-c463-4d24-a50d-241928a6609e req-8091a343-61ad-4dde-adb0-16626d03070d service nova] Creating event network-changed:6c5ca3a5-989e-4775-9839-4980ee405ae9 for instance 880f65f6-c574-48a5-8868-6979fc8a834a on hv-cinder-83754 Jun 16 17:42:27.403958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-2b71753c-c463-4d24-a50d-241928a6609e req-8091a343-61ad-4dde-adb0-16626d03070d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065586 Jun 16 17:42:27.405457 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 480/971] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:27.975191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:27.975726 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:27.982628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:27.983085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:27.983864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:27.984306 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:28.000129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 HTTP/1.1 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:42:28.002683 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.004546 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'ade4cabc-bd7b-4506-b836-9178181c78e2'} Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:28.005536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.007086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.008722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:28.008722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7b612be2-3720-48e9-8308-ea19b1f754d2 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 404 len: 111 microversion: 2.20 time: 0.032917 Jun 16 17:42:28.008722 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 492/972] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jun 16 17:42:27 2022] DELETE /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:42:28.014047 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:28.014753 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] [instance: ade4cabc-bd7b-4506-b836-9178181c78e2] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:28.022842 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:28.023296 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:28.024081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:28.024519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:28.039187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] HTTP exception thrown: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Request method failure captured: Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 HTTP/1.1 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2nz1nCCwZnA_YBOO6KP7eiyZbTnl0LKGV_cVgUWnYhq5_X9lgBVgvwO5zlAbkCmKs4Ku6T8TTINS4qSSoGD0x7UChqQqo00Gv8NxBWKShXPxzkQB8ihZ1uxM-QA_CRG_bkkUiir4WW_Yb0NVIcvtr6a8HA8jcXEjs6oeFYHbstCG3o Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:42:28.040871 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34fb554e0cf14c7ab3a9f538273c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34fb554e0cf14c7ab3a9f538273c289e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34fb554e0cf14c7ab3a9f538273c289e"}]}] Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 34fb554e0cf14c7ab3a9f538273c289e Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-60097580 Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 2fbaf6d894e64f19bf041e7be20a6242 Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-AttachVolumeShelveTestJSON-60097580-project Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.043333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'ade4cabc-bd7b-4506-b836-9178181c78e2'} Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:42:28.044290 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. Jun 16 17:42:28.045895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:42:28.048190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] Returning 404 to user: Instance ade4cabc-bd7b-4506-b836-9178181c78e2 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:42:28.048190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c65834d6-bd54-4d0a-8ac3-01d6cb849ed9 tempest-AttachVolumeShelveTestJSON-60097580 tempest-AttachVolumeShelveTestJSON-60097580-project] 10.222.0.40 "GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2" status: 404 len: 111 microversion: 2.20 time: 0.033241 Jun 16 17:42:28.048190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 481/973] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jun 16 17:42:28 2022] GET /compute/v2.1/servers/ade4cabc-bd7b-4506-b836-9178181c78e2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 17:42:28.273008 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:28.274189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:28.280507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:28.280951 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:28.282602 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:28.283342 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:28.673200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:28.681168 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a4559f6f-1d66-42ec-ab7d-71724a6119fb tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.412469 Jun 16 17:42:28.681770 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 493/974] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:28 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:29.020827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:29.022570 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:29.036858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.037696 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:29.038553 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.039027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:29.131756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-4573add8-4f21-41b3-8673-0c427712a50c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action" status: 202 len: 0 microversion: 2.1 time: 0.115666 Jun 16 17:42:29.135890 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 482/975] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:42:29 2022] POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:42:29.142085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:29.146210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:29.155393 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.157191 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:29.158912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.159451 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:29.561860 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:29.571021 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8765b325-7e83-46ca-b97b-e528d013224b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1752 microversion: 2.1 time: 0.433880 Jun 16 17:42:29.571602 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 494/976] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:29 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1752 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:29.699349 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:29.700048 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:29.707360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.707808 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:29.708595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:29.709029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:30.206273 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:30.213943 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a312c636-88b0-42a3-9976-e928eebd2864 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.518770 Jun 16 17:42:30.214712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 483/977] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:29 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:30.589441 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:30.590729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:30.600657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:30.600657 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:30.601165 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:30.601695 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:30.837032 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:30.846358 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-8f7006d8-038c-437b-9c0c-5c286244fcfb tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1752 microversion: 2.1 time: 0.260711 Jun 16 17:42:30.847085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 495/978] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:30 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:31.231955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:31.233852 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:31.241765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:31.242540 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:31.243483 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:31.244827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:31.583814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:31.591475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-a0faa4f4-7192-4ac9-99b8-4a2eee70b050 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.363744 Jun 16 17:42:31.592055 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 484/979] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:31 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:31.871282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:31.872465 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:31.880062 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:31.880698 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:31.881593 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:31.882104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:32.076648 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:32.087853 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-dd54fe54-a369-4879-8fd2-fa855daa86d5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1752 microversion: 2.1 time: 0.227743 Jun 16 17:42:32.088446 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 496/980] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:31 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:32.608481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:32.611149 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:32.617258 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:32.619182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:32.619476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:32.620266 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:32.620881 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:32.881360 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:32.890170 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9392c817-0a87-4151-b367-301bbdf60565 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.285970 Jun 16 17:42:32.892027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 485/981] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:32 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:33.106741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:33.107347 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:33.115929 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:33.117041 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:33.117868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:33.118348 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:33.292628 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:33.306309 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-eed774f2-4dcb-4bc0-9fac-e9f948daf8e5 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1752 microversion: 2.1 time: 0.203286 Jun 16 17:42:33.307715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 497/982] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:33 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1752 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:33.908665 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:33.910015 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:33.911198 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:33.911979 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=8 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:33.919021 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:33.919468 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:33.920249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:33.920687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:34.064854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:34.072804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-48e1948b-919f-445a-af58-6e56b2983833 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.168770 Jun 16 17:42:34.073422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 486/983] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:33 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:34.324186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:34.324747 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:34.332528 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:34.332976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:34.333916 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:34.334555 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:34.523946 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:34.533708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-bc8b7643-ab38-4125-8b42-446f87216985 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.213360 Jun 16 17:42:34.534355 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 498/984] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:34 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:35.090416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:35.091019 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:35.097716 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:35.098158 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:35.098926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:35.099356 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:35.251743 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:35.254176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:35.261771 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ab2bb138-7003-41a7-a18b-3abd1e7107d4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.174900 Jun 16 17:42:35.262362 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 487/985] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:35 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:35.553092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:35.554479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:35.561762 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:35.563315 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:35.564496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:35.565096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:35.737405 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:35.746789 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e9591610-5d60-47c7-9ecf-8f3e7e85f16b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.198354 Jun 16 17:42:35.747352 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 499/986] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:35 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:36.278677 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:36.279293 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:36.288400 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:36.288928 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:36.289742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:36.290185 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:36.429604 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:36.437756 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d39659a1-1176-4f52-9d60-8a0d9a818b1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.162397 Jun 16 17:42:36.438503 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 488/987] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:36 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:36.766034 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:36.766849 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:36.773768 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:36.774524 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:36.775539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:36.776057 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:36.942357 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:36.951178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9929b4de-3ab2-4cd0-be8b-5875312bf033 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.189591 Jun 16 17:42:36.951768 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 500/988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:36 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:37.455777 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:37.456533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:37.465114 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:37.465663 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:37.466518 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:37.467029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:37.648644 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:37.659130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d4c82b58-f5f8-4b7d-a7a0-e86734f88dde tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.208181 Jun 16 17:42:37.660066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 489/989] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:37 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:37.686793 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-93c09bdf-8e50-4bc3-ac46-366ceaaa21fa req-ccdb6636-d84d-4db5-a396-f497e106d579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880f65f6-c574-48a5-8868-6979fc8a834a", "name": "network-vif-plugged", "status": "completed", "tag": "6c5ca3a5-989e-4775-9839-4980ee405ae9"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:37.695917 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-93c09bdf-8e50-4bc3-ac46-366ceaaa21fa req-ccdb6636-d84d-4db5-a396-f497e106d579 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:37.696367 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-93c09bdf-8e50-4bc3-ac46-366ceaaa21fa req-ccdb6636-d84d-4db5-a396-f497e106d579 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:37.710364 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-93c09bdf-8e50-4bc3-ac46-366ceaaa21fa req-ccdb6636-d84d-4db5-a396-f497e106d579 service nova] Creating event network-vif-plugged:6c5ca3a5-989e-4775-9839-4980ee405ae9 for instance 880f65f6-c574-48a5-8868-6979fc8a834a on hv-cinder-83754 Jun 16 17:42:37.716234 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-93c09bdf-8e50-4bc3-ac46-366ceaaa21fa req-ccdb6636-d84d-4db5-a396-f497e106d579 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033138 Jun 16 17:42:37.716838 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 501/990] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:37.969891 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:37.970501 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:37.976674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:37.977120 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:37.977923 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:37.978354 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:38.137359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:38.146785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8f509903-ef0f-4d8f-be2b-ab70be5e7e14 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.181605 Jun 16 17:42:38.147363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 490/991] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:37 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:38.679359 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:38.681220 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:38.691586 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:38.692042 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:38.692817 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:38.693282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:38.834969 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:38.842719 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-4f4ec28e-eeb5-4f9c-970b-40ae1b83417c tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.170606 Jun 16 17:42:38.843827 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 502/992] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:38 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:39.163816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:39.164402 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:39.170941 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:39.171924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:39.172931 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:39.173350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:39.340901 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:39.351903 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2d8f87d2-8ce1-4b7e-bdc3-42d082089c05 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.191929 Jun 16 17:42:39.353192 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 491/993] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:39 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:39.860812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:39.861585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:39.868246 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:39.868812 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:39.869704 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:39.870235 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:40.010627 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:40.019134 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a871f93a-7372-4312-9deb-ac8724f7852a tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.162949 Jun 16 17:42:40.019715 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 503/994] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:39 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:40.379810 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:40.380422 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:40.387600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:40.388040 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:40.388801 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:40.389255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:40.814182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:40.822957 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3b18b6b2-02e6-4a14-abb0-6fcb837e5d74 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.447182 Jun 16 17:42:40.823712 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 492/995] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:40 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:41.036397 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:41.037019 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:41.043684 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:41.044131 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:41.044900 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:41.045371 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:41.188177 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:41.195718 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ce8588ad-50fd-45b6-be2b-0c38fe4accd9 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.163142 Jun 16 17:42:41.196506 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 504/996] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:41 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:41.839607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:41.840217 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:41.848017 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:41.848255 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:41.849054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:41.849517 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:42.002333 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:42.010279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-78fee602-5868-4817-846e-d3799cab7c0c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.174532 Jun 16 17:42:42.010847 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 493/997] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:41 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:42.213644 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:42.214239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:42.222059 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:42.222507 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:42.223326 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:42.223765 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:42.364496 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:42.368056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=100 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:42:42.373595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-61f238ac-b2a2-41ab-a1f0-cb4ca6d6f480 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1265 microversion: 2.1 time: 0.163782 Jun 16 17:42:42.374174 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 505/998] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:42 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:43.028418 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:43.029142 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:43.036571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.037306 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.038146 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.038746 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.213998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:43.225377 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-fb451826-51be-47e2-9fb2-6d3d259bf216 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.200784 Jun 16 17:42:43.226001 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 494/999] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:43 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:43.370921 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d874f74-b335-407c-9a15-e28b4b800fed", "device": "/dev/sdb"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:43.372482 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:43.379200 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.379646 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.380420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.380854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.391761 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:43.392683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:43.399009 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.399460 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.400240 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.400678 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.547783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:43.555800 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f8c11b09-b7fa-4a28-ac72-d78da4a65566 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1452 microversion: 2.1 time: 0.168377 Jun 16 17:42:43.556398 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 495/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:43 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:43.573176 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:43.574086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:43.580543 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.580983 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.581785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:43.582213 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:43.645541 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f6af4770-286d-49b0-afaf-b011b7417e5a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "POST /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278952 Jun 16 17:42:43.651210 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 506/1001] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:42:43 2022] POST /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:42:43.736093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:43.743887 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-eca8f0e6-9cf9-4293-8a7f-bf34e875c2d6 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1452 microversion: 2.1 time: 0.174395 Jun 16 17:42:43.744481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 496/1002] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:43 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:44.248307 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:44.249361 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:44.259667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:44.261205 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:44.262253 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:44.262963 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:44.513782 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:44.523193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-f4f980a1-0381-4724-8ffd-c7eb39b87d9b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.281590 Jun 16 17:42:44.523775 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 507/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:44 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:45.543125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:45.543789 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:45.553413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:45.554544 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:45.555650 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:45.556174 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:45.811860 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:45.825632 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b7e307e1-9678-46d7-9a22-d26d10a1714d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.287361 Jun 16 17:42:45.826815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 497/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:45 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:45.993959 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-d4bce5ba-fab6-42d2-a999-55844e98e764 req-a2422f6c-a1d7-48b6-abc2-b6f80a08845a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880f65f6-c574-48a5-8868-6979fc8a834a", "tag": "6c5ca3a5-989e-4775-9839-4980ee405ae9"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:42:46.005599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-d4bce5ba-fab6-42d2-a999-55844e98e764 req-a2422f6c-a1d7-48b6-abc2-b6f80a08845a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:46.006338 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-d4bce5ba-fab6-42d2-a999-55844e98e764 req-a2422f6c-a1d7-48b6-abc2-b6f80a08845a service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:46.020028 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-d4bce5ba-fab6-42d2-a999-55844e98e764 req-a2422f6c-a1d7-48b6-abc2-b6f80a08845a service nova] Creating event network-changed:6c5ca3a5-989e-4775-9839-4980ee405ae9 for instance 880f65f6-c574-48a5-8868-6979fc8a834a on hv-cinder-83754 Jun 16 17:42:46.027221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-d4bce5ba-fab6-42d2-a999-55844e98e764 req-a2422f6c-a1d7-48b6-abc2-b6f80a08845a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037342 Jun 16 17:42:46.028638 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 508/1005] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:42:46.844325 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:46.846036 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:46.856115 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:46.857387 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:46.858206 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:46.858804 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:47.053694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:47.065546 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1755683d-0a49-4055-880b-0d3629604e17 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.225699 Jun 16 17:42:47.076645 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 498/1006] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:46 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:48.086985 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:48.087695 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:48.096002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:48.096986 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:48.097924 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:48.098583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:48.347756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:48.358491 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-cf8f8430-ed13-4b17-8b50-ce8c83ebd683 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.277105 Jun 16 17:42:48.359989 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 509/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:48 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:49.380049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:49.380875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:49.387765 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:49.388215 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:49.388997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:49.389613 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:49.595307 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:49.610127 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bd6db6bd-7f67-4f1f-93c5-1fc862b673f7 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.235461 Jun 16 17:42:49.611452 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 499/1008] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:49 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:50.628811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:50.630353 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:50.637297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:50.637753 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:50.638536 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:50.638987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:50.830688 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:50.838981 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c1bb494a-0f1e-4a1a-ad0a-a8a7b51009c4 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.214964 Jun 16 17:42:50.839668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 510/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:50 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:42:51.857758 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:51.858509 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:51.866437 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:51.866882 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:51.867875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:51.868394 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:52.033661 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:52.048556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2eb4f814-a16d-4f63-a056-9f008afcf7f3 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.195171 Jun 16 17:42:52.049178 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 500/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:51 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:53.068716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:53.069394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:53.076708 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:53.077196 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:53.079499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:53.079499 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:53.223595 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:53.232280 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-526f75a7-4b72-4469-81cd-09dd4a4fc9b8 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.167307 Jun 16 17:42:53.232872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 511/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:53 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:54.252153 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:54.252794 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:54.259682 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:54.260236 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:54.261109 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:54.261640 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:54.422906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:54.431016 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f413cd59-53a9-4b27-9f0f-98d3db5f24bd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1757 microversion: 2.1 time: 0.184138 Jun 16 17:42:54.431599 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 501/1012] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:54 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:42:55.449976 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:42:55.450537 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:42:55.458994 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:55.459449 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:55.460236 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:42:55.460679 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:42:55.622155 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:42:55.631599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-e72535c2-80e2-4796-87f6-4b3dfdb3556c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1760 microversion: 2.1 time: 0.185627 Jun 16 17:42:55.632186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 512/1013] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:42:55 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:08.017050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-285259985", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:08.023595 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=33 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:08.024287 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=85 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:08.076118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.network.neutron [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] validate_networks() for None {{(pid=124160) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:43:08.635208 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Flavor limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:43:08.635839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Image limits 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:43:08.636312 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Flavor pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:43:08.636754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Image pref 0:0:0 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:43:08.637288 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.virt.hardware [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124160) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:43:08.648567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:08.649004 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:08.651497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:08.651497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:08.669519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Getting quotas for project 2d208bc7521b47589bc3bcf5394fd361. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:43:08.673851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.quota [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Getting quotas for user 3fb39b017d944d7d9808649e85903d43 and project 2d208bc7521b47589bc3bcf5394fd361. Resources: {'cores', 'ram', 'instances'} {{(pid=124160) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:43:08.685519 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Going to run 1 instances... {{(pid=124160) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:43:08.688056 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124160) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:43:08.773725 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-cc0cee9e-65c7-4e2a-bb06-9076aa5135ce tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761017 Jun 16 17:43:08.781711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 502/1014] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 17:43:08.789004 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a8686f97-91ce-494a-8e7f-4ad31ec8e1f9 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:08.789789 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a8686f97-91ce-494a-8e7f-4ad31ec8e1f9 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:08.792389 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=45 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:08.793066 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:08.901646 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-a8686f97-91ce-494a-8e7f-4ad31ec8e1f9 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:08.920258 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a8686f97-91ce-494a-8e7f-4ad31ec8e1f9 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1214 microversion: 2.1 time: 0.136600 Jun 16 17:43:08.930294 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 513/1015] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:08 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:09.940853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:09.941969 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:09.952298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:09.952854 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:09.953930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:09.954440 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:09.971874 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:09.973869 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:09.987136 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:09.988429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:09.989733 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:09.990562 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:10.066384 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:10.075093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b1adaf5a-06f7-4de3-8a56-0cd150bd8b07 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1274 microversion: 2.1 time: 0.140345 Jun 16 17:43:10.078578 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 503/1016] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:09 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:10.147284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lazy-loading 'services' on Instance uuid ce1c7182-f0ad-44cd-b16f-427e775c2d82 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:43:10.254893 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-a40144f3-55d1-41ed-84b1-6840c2f3a32c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82/os-volume_attachments/5d874f74-b335-407c-9a15-e28b4b800fed" status: 202 len: 0 microversion: 2.1 time: 0.289148 Jun 16 17:43:10.255944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 514/1017] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:43:09 2022] DELETE /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82/os-volume_attachments/5d874f74-b335-407c-9a15-e28b4b800fed => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:43:11.100583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:11.101965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:11.110675 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.111368 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.112284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.112722 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.413538 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:11.426260 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:11.427051 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:11.427491 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8f2b30c0-f593-490c-9fe0-6d7cb82f2675 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.331568 Jun 16 17:43:11.428311 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 504/1018] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:11 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:11.434103 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.434558 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.435330 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.437295 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.465767 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:43:11.570374 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3ab531c0-1603-4112-be29-2e0d1b49c866 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 204 len: 0 microversion: 2.1 time: 0.151089 Jun 16 17:43:11.571630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 515/1019] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:43:11 2022] DELETE /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:43:11.585797 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:11.586747 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:11.596474 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.597128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.598045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:11.598550 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:11.855393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:11.867029 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f7d2d621-6880-4904-9e75-07dea393ef9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1512 microversion: 2.1 time: 0.288396 Jun 16 17:43:11.867901 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 505/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:11 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:12.039109 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-10316fd8-8019-4906-8bb6-cdad7520544e req-32c84ef1-9a3e-4ad1-9fa7-f2bf0c690bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c72f90e-208f-46bb-a40c-6874fbe3219e", "tag": "70beb5d2-132e-4921-83a0-76dd58f793ba"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:12.051881 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-10316fd8-8019-4906-8bb6-cdad7520544e req-32c84ef1-9a3e-4ad1-9fa7-f2bf0c690bef service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:12.052700 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-10316fd8-8019-4906-8bb6-cdad7520544e req-32c84ef1-9a3e-4ad1-9fa7-f2bf0c690bef service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:12.071843 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-10316fd8-8019-4906-8bb6-cdad7520544e req-32c84ef1-9a3e-4ad1-9fa7-f2bf0c690bef service nova] Creating event network-changed:70beb5d2-132e-4921-83a0-76dd58f793ba for instance 0c72f90e-208f-46bb-a40c-6874fbe3219e on hv-cinder-83754 Jun 16 17:43:12.078247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-10316fd8-8019-4906-8bb6-cdad7520544e req-32c84ef1-9a3e-4ad1-9fa7-f2bf0c690bef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044466 Jun 16 17:43:12.078928 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 516/1021] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:12.446187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:12.446816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:12.453817 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:12.454261 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:12.455045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:12.455476 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:12.599452 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:12.608571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7e9d0268-4a2e-4f3d-8698-9ddb6c715628 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.166214 Jun 16 17:43:12.609220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 506/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:12 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:12.885298 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:12.886002 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:12.892575 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:12.893020 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:12.893821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:12.894252 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:13.054851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:13.063748 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3637c69d-7cd6-4b13-a546-c4a79a54dae8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1512 microversion: 2.1 time: 0.183375 Jun 16 17:43:13.064414 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 517/1023] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:12 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:13.626309 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:13.627093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:13.634568 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:13.635013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:13.635810 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:13.636243 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:14.024343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:14.032698 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6d9a3a7f-f666-4785-96b9-87154150405d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.410771 Jun 16 17:43:14.033321 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 507/1024] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:13 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:14.094050 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:14.094805 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:14.102278 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:14.102837 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:14.103653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:14.104093 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:14.428517 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:14.441763 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-5daa188e-6209-47d7-9646-43e343c5a3e8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1512 microversion: 2.1 time: 0.352897 Jun 16 17:43:14.442786 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 518/1025] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:14 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:14.621526 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-985b6138-4e1b-4d14-8f40-2c0620991e32 req-a7b0ccec-40d8-4178-a701-4a21bc033f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1c7182-f0ad-44cd-b16f-427e775c2d82", "name": "network-vif-deleted", "tag": "f6ceb8b6-33ce-4014-9702-8fb437b60ab0"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:14.630987 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-985b6138-4e1b-4d14-8f40-2c0620991e32 req-a7b0ccec-40d8-4178-a701-4a21bc033f82 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:14.631690 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-985b6138-4e1b-4d14-8f40-2c0620991e32 req-a7b0ccec-40d8-4178-a701-4a21bc033f82 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:14.645790 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-985b6138-4e1b-4d14-8f40-2c0620991e32 req-a7b0ccec-40d8-4178-a701-4a21bc033f82 service nova] Creating event network-vif-deleted:f6ceb8b6-33ce-4014-9702-8fb437b60ab0 for instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 on hv-cinder-83754 Jun 16 17:43:14.651132 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-985b6138-4e1b-4d14-8f40-2c0620991e32 req-a7b0ccec-40d8-4178-a701-4a21bc033f82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Jun 16 17:43:14.651752 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 508/1026] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:15.050344 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:15.050954 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:15.057190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:15.057716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:15.058532 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:15.059010 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:15.197714 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:15.206599 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-dfd186ca-4968-4dd6-8538-2561763aafef tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.160271 Jun 16 17:43:15.207183 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 519/1027] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:15 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:15.459842 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:15.460535 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:15.466973 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:15.467413 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:15.468187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:15.468607 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:15.503209 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:15.503659 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:15.504110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lazy-loading 'fault' on Instance uuid ce1c7182-f0ad-44cd-b16f-427e775c2d82 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:43:15.549629 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:15.557182 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-ada84863-95f0-4434-9fc2-704a15daddc1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 200 len: 1308 microversion: 2.1 time: 0.101531 Jun 16 17:43:15.557841 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 509/1028] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:15 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:16.223717 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:16.224459 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:16.231327 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:16.231779 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:16.233105 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:16.233561 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:16.378854 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:16.392705 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-3cbfb49e-d03b-4fe7-b925-30721046bedb tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.172378 Jun 16 17:43:16.393792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 520/1029] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:16 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:16.575008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:16.575612 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: ce1c7182-f0ad-44cd-b16f-427e775c2d82] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:16.582835 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:16.583279 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:16.584042 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:16.584479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:16.598337 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] HTTP exception thrown: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Request method failure captured: Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 HTTP/1.1 Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2timO4JWqh1F_Ux4ty_-Rlm0HbgfiwEot_z7YwWz4fo5qwgdAauGo0b9qRg_7z3jtWIwjb2D0NFyYkNcb79qQhxIVbOW9D3KmWbe6rpbmrZGPFpbP7-Gxt8ljNRZQ0673apsIGm4grfKev2ELmctWE2bt0PthfuJX-eFyNyFB15Mzs Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 554c281060a446ed9b2d02bad7b8ec1d Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:43:16.600025 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/554c281060a446ed9b2d02bad7b8ec1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/554c281060a446ed9b2d02bad7b8ec1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_554c281060a446ed9b2d02bad7b8ec1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/554c281060a446ed9b2d02bad7b8ec1d"}]}] Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 554c281060a446ed9b2d02bad7b8ec1d Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesSnapshotTestJSON-1672951330-project Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 9de9e460242c4a02ad28af485ad851e5 Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesSnapshotTestJSON-1672951330-project Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. Jun 16 17:43:16.602895 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'ce1c7182-f0ad-44cd-b16f-427e775c2d82'} Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:43:16.604343 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. Jun 16 17:43:16.606958 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:16.609220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Returning 404 to user: Instance ce1c7182-f0ad-44cd-b16f-427e775c2d82 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:43:16.609220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7bdac4de-930d-4cc5-a9a4-bb634d023fd3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82" status: 404 len: 111 microversion: 2.1 time: 0.030314 Jun 16 17:43:16.609220 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 510/1030] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:16 2022] GET /compute/v2.1/servers/ce1c7182-f0ad-44cd-b16f-427e775c2d82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:43:17.411231 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:17.411832 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:17.418417 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:17.418868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:17.420630 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:17.421078 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:17.564716 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:17.572895 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-469b5e60-a336-4147-b835-2f0dbbb2faa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.165488 Jun 16 17:43:17.573515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 521/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:17 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:18.590600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:18.591202 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:18.598720 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:18.599172 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:18.599952 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:18.600393 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:18.658713 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=2 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:18.680314 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell0:SELECT=6 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:18.735910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:18.744093 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-7622d2ad-7664-4857-af1b-bbc6b6460aa2 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.157411 Jun 16 17:43:18.744674 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 511/1032] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:18 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:19.763086 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:19.764116 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:19.766709 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:19.772376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:19.772823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:19.773736 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:19.774169 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:19.911583 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:19.919186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ed2dc2d0-665b-42a9-8c4f-860b961fd0a5 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.160479 Jun 16 17:43:19.920732 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 522/1033] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:19 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:20.937600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:20.938213 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:20.945329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:20.945329 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:20.946556 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:20.946988 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:21.096004 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:21.104260 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-894efa35-3d35-499f-94f6-35a44d529b37 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.170613 Jun 16 17:43:21.104910 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 512/1034] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:20 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:22.123056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:22.124376 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:22.133284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:22.133987 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:22.135725 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:22.136327 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:22.168424 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-9707e3fe-3d85-4c9c-abbb-235e09f4f945 req-4f0114dd-c5b0-45e3-abcc-1faf3ad28c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72f90e-208f-46bb-a40c-6874fbe3219e", "name": "network-vif-plugged", "status": "completed", "tag": "70beb5d2-132e-4921-83a0-76dd58f793ba"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:22.185724 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9707e3fe-3d85-4c9c-abbb-235e09f4f945 req-4f0114dd-c5b0-45e3-abcc-1faf3ad28c1b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:22.186165 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-9707e3fe-3d85-4c9c-abbb-235e09f4f945 req-4f0114dd-c5b0-45e3-abcc-1faf3ad28c1b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:22.234982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-9707e3fe-3d85-4c9c-abbb-235e09f4f945 req-4f0114dd-c5b0-45e3-abcc-1faf3ad28c1b service nova] Creating event network-vif-plugged:70beb5d2-132e-4921-83a0-76dd58f793ba for instance 0c72f90e-208f-46bb-a40c-6874fbe3219e on hv-cinder-83754 Jun 16 17:43:22.255995 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-9707e3fe-3d85-4c9c-abbb-235e09f4f945 req-4f0114dd-c5b0-45e3-abcc-1faf3ad28c1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090684 Jun 16 17:43:22.257027 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 513/1035] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:22.352104 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:22.362392 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9033399c-656f-4ce0-af5e-d40baef47d9d tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.244725 Jun 16 17:43:22.362984 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 523/1036] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:22 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:23.380419 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:23.381125 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:23.388717 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:23.389184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:23.390177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:23.390853 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:23.564502 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:23.572013 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-8a2df3c2-55e5-45d8-9f54-067d107ea828 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.195991 Jun 16 17:43:23.572580 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 514/1037] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:23 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:24.590280 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:24.590898 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:24.597450 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:24.597905 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:24.598664 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:24.599099 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:24.737556 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:24.744944 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-386b80b1-a331-4f1a-9a96-b06c3f7e1654 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.158644 Jun 16 17:43:24.745554 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 524/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:24 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:25.762433 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:25.763776 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:25.770815 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:25.771264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:25.772043 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:25.772479 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:25.927366 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:25.935299 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-018b6a30-b76d-4460-b6e7-5202560dd571 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1314 microversion: 2.1 time: 0.176693 Jun 16 17:43:25.936041 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 515/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:25 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:26.607829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1692071402", "imageRef": "3141e379-4b62-4ec0-822d-d5e624ecf1c5", "flavorRef": "452", "networks": [{"uuid": "c46d647a-b877-4cb5-9d41-f29712e06919"}]}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:26.665821 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.network.neutron [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] validate_networks() for [('c46d647a-b877-4cb5-9d41-f29712e06919', None, None, None, None, None)] {{(pid=124161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 17:43:26.953525 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:26.956184 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:26.963835 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:26.964281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:26.965111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:26.965719 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.360211 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Flavor limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 17:43:27.360640 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Image limits 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 17:43:27.361178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Flavor pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 17:43:27.361598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Image pref 0:0:0 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 17:43:27.362073 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.virt.hardware [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 17:43:27.372178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.373060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.374024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.374611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.394875 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Getting quotas for project 554c281060a446ed9b2d02bad7b8ec1d. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 17:43:27.399287 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.quota [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Getting quotas for user 9de9e460242c4a02ad28af485ad851e5 and project 554c281060a446ed9b2d02bad7b8ec1d. Resources: {'cores', 'ram', 'instances'} {{(pid=124161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 17:43:27.404739 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:27.413690 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b5fa5d70-4ce0-4e7e-ab9e-3fb48e390f13 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1464 microversion: 2.1 time: 0.464956 Jun 16 17:43:27.414298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 516/1040] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:26 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1464 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:27.414518 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Going to run 1 instances... {{(pid=124161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 17:43:27.416826 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3141e379-4b62-4ec0-822d-d5e624ecf1c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 17:43:27.456961 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:27.457487 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:27.465075 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.465583 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.466889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.467426 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.471055 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-c433d060-1050-44ff-a8c0-bd7a1f385749 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867211 Jun 16 17:43:27.471930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 525/1041] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jun 16 17:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 17:43:27.484885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ff130925-df7f-49c3-b00e-3ce5a7437df8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:27.485615 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ff130925-df7f-49c3-b00e-3ce5a7437df8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:27.497615 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:43:27.565636 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ff130925-df7f-49c3-b00e-3ce5a7437df8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:27.578292 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ff130925-df7f-49c3-b00e-3ce5a7437df8 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1219 microversion: 2.1 time: 0.099222 Jun 16 17:43:27.579317 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 526/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:27 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:27.605838 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-83bc7ff1-db18-4e7b-9cdf-fe42e0bad59f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 204 len: 0 microversion: 2.1 time: 0.152085 Jun 16 17:43:27.607996 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 517/1043] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:43:27 2022] DELETE /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 17:43:27.619511 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:27.620408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:27.633085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.633600 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.634530 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:27.634974 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:27.809006 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:27.818862 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-33a925ce-ecfd-4beb-867d-738dad1a979f tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1470 microversion: 2.1 time: 0.203830 Jun 16 17:43:27.819470 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 527/1044] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:27 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:28.604513 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:28.605247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:28.612997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:28.613512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:28.614450 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:28.614875 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:28.683570 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:28.692350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-38e0803c-7e69-4a43-bb46-997929cbe651 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1223 microversion: 2.1 time: 0.092525 Jun 16 17:43:28.692929 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 518/1045] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:28 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:28.837559 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:28.838282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:28.845958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:28.846590 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:28.847394 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:28.847861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:29.001616 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:29.010474 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-22900a57-97d9-4828-9820-ab13ea99d141 tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1470 microversion: 2.1 time: 0.176829 Jun 16 17:43:29.017274 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 528/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:28 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:29.709992 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:29.710884 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:29.717926 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:29.718375 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:29.719361 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:29.719800 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:29.724110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:29.823796 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:29.832864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b054d4e7-17bc-4585-a7f2-b0a2fb367682 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1277 microversion: 2.1 time: 0.127221 Jun 16 17:43:29.833481 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 519/1047] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:29 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:30.029774 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:30.031129 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:30.038452 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:30.038914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:30.039706 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:30.040147 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:30.058908 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-2f985b41-06e8-40f7-9a84-a4f96848b45e req-a565b9a1-3b9f-4dba-baa8-c9cc1d0526de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72f90e-208f-46bb-a40c-6874fbe3219e", "name": "network-vif-deleted", "tag": "70beb5d2-132e-4921-83a0-76dd58f793ba"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:30.075953 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2f985b41-06e8-40f7-9a84-a4f96848b45e req-a565b9a1-3b9f-4dba-baa8-c9cc1d0526de service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:30.076721 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-2f985b41-06e8-40f7-9a84-a4f96848b45e req-a565b9a1-3b9f-4dba-baa8-c9cc1d0526de service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:30.104567 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-2f985b41-06e8-40f7-9a84-a4f96848b45e req-a565b9a1-3b9f-4dba-baa8-c9cc1d0526de service nova] Creating event network-vif-deleted:70beb5d2-132e-4921-83a0-76dd58f793ba for instance 0c72f90e-208f-46bb-a40c-6874fbe3219e on hv-cinder-83754 Jun 16 17:43:30.112095 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-2f985b41-06e8-40f7-9a84-a4f96848b45e req-a565b9a1-3b9f-4dba-baa8-c9cc1d0526de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057090 Jun 16 17:43:30.112715 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 520/1048] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:30.151112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb39b017d944d7d9808649e85903d43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d208bc7521b47589bc3bcf5394fd361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:30.161515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-aa4b8f7d-cf52-4c3a-b8e7-0606597d19fd tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 200 len: 1428 microversion: 2.1 time: 0.136130 Jun 16 17:43:30.162108 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 529/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:30 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:30.851559 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:30.852265 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:30.862190 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:30.863281 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:30.864058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:30.864491 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:31.107533 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:31.118118 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1187197e-1194-483f-8337-44a0aeb69cae tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.271346 Jun 16 17:43:31.118791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 521/1050] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:30 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:31.179411 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:31.180128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] [instance: 0c72f90e-208f-46bb-a40c-6874fbe3219e] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:31.188022 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:31.188480 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:31.189525 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:31.190083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:31.206125 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] HTTP exception thrown: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Request method failure captured: Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e HTTP/1.1 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2uqazWuPvkZF0bq5v8aijuCvtgzMLuxeNvnVDxUhXqoWklFPB1QVzrokjJ8EOIjf9gqeaNPR_fetb107zERM64kLCjCIFcF1UOA2QPPdjU4tXpeyAQuwPzUMFOsufale0MBYAJ5eRw9UDsqYj8TsEq7C_SAsxSEepjfDzcxDZQvi74 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 2d208bc7521b47589bc3bcf5394fd361 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-VolumesNegativeTest-1560140088 Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:43:31.207809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d208bc7521b47589bc3bcf5394fd361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d208bc7521b47589bc3bcf5394fd361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2d208bc7521b47589bc3bcf5394fd361", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2d208bc7521b47589bc3bcf5394fd361"}]}] Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-VolumesNegativeTest-1560140088 Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 2d208bc7521b47589bc3bcf5394fd361 Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-VolumesNegativeTest-1560140088 Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-VolumesNegativeTest-1560140088-project Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: 3fb39b017d944d7d9808649e85903d43 Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-VolumesNegativeTest-1560140088-project Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. Jun 16 17:43:31.210407 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '0c72f90e-208f-46bb-a40c-6874fbe3219e'} Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:43:31.211423 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. Jun 16 17:43:31.212823 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:43:31.214087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] Returning 404 to user: Instance 0c72f90e-208f-46bb-a40c-6874fbe3219e could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:43:31.214087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-59a86288-3eac-451c-8028-f5ddba860d5a tempest-VolumesNegativeTest-1560140088 tempest-VolumesNegativeTest-1560140088-project] 10.222.0.40 "GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e" status: 404 len: 111 microversion: 2.1 time: 0.033747 Jun 16 17:43:31.214087 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 530/1051] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:31 2022] GET /compute/v2.1/servers/0c72f90e-208f-46bb-a40c-6874fbe3219e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:43:32.128692 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-dac26161-d4e1-4ce5-b54d-4a441a68052c req-67fa6da3-7389-4ff1-bc5d-b089bdd34a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d0846b-c4b5-4931-8752-4a71919b4b78", "tag": "99ed25c1-10d3-4534-bc18-a08b9bb5025c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:32.135608 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:32.136261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:32.140890 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-dac26161-d4e1-4ce5-b54d-4a441a68052c req-67fa6da3-7389-4ff1-bc5d-b089bdd34a1b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:32.141428 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-dac26161-d4e1-4ce5-b54d-4a441a68052c req-67fa6da3-7389-4ff1-bc5d-b089bdd34a1b service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:32.144371 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:32.144829 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:32.145825 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:32.146261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:32.151024 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:32.156497 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-dac26161-d4e1-4ce5-b54d-4a441a68052c req-67fa6da3-7389-4ff1-bc5d-b089bdd34a1b service nova] Creating event network-changed:99ed25c1-10d3-4534-bc18-a08b9bb5025c for instance 86d0846b-c4b5-4931-8752-4a71919b4b78 on hv-cinder-83754 Jun 16 17:43:32.162544 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-dac26161-d4e1-4ce5-b54d-4a441a68052c req-67fa6da3-7389-4ff1-bc5d-b089bdd34a1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037244 Jun 16 17:43:32.163471 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 522/1052] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:32.301554 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:32.309494 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-377e2a98-ec40-4ab9-afb3-0ccf45d7555c tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.178056 Jun 16 17:43:32.310262 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 531/1053] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:32 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:33.327571 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:33.328823 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:33.335456 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:33.335896 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:33.341054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:33.341054 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:33.483037 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:33.491927 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-59996fdf-de93-44e8-81c0-9159a6a85d78 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.169137 Jun 16 17:43:33.492378 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 523/1054] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:33 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:43:34.508810 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:34.509514 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:34.516160 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:34.516611 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:34.517912 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:34.518362 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:34.666401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:34.674598 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-724842f9-2a73-4795-b9f0-d6503e2e8552 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.169736 Jun 16 17:43:34.675175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 532/1055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:34 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:35.691145 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:35.691742 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:35.698230 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:35.698673 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:35.699435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:35.700126 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:35.860003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:35.873864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-6010c55d-22a2-4864-bec3-3b961245c5b1 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.183838 Jun 16 17:43:35.873864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 524/1056] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:35 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:36.219056 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-7fbcbfef-539f-4196-805a-19f405257761 req-cef1145b-aca1-4ec0-95b7-c30084b1e594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d0846b-c4b5-4931-8752-4a71919b4b78", "name": "network-vif-plugged", "status": "completed", "tag": "99ed25c1-10d3-4534-bc18-a08b9bb5025c"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:36.251729 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7fbcbfef-539f-4196-805a-19f405257761 req-cef1145b-aca1-4ec0-95b7-c30084b1e594 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:36.252475 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-7fbcbfef-539f-4196-805a-19f405257761 req-cef1145b-aca1-4ec0-95b7-c30084b1e594 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:36.266661 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-7fbcbfef-539f-4196-805a-19f405257761 req-cef1145b-aca1-4ec0-95b7-c30084b1e594 service nova] Creating event network-vif-plugged:99ed25c1-10d3-4534-bc18-a08b9bb5025c for instance 86d0846b-c4b5-4931-8752-4a71919b4b78 on hv-cinder-83754 Jun 16 17:43:36.273222 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-7fbcbfef-539f-4196-805a-19f405257761 req-cef1145b-aca1-4ec0-95b7-c30084b1e594 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059942 Jun 16 17:43:36.274519 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 533/1057] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:36.892022 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:36.892652 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:36.899404 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:36.899843 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:36.900643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:36.901573 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:37.041930 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:37.049466 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-aaaeb21f-4062-4431-bb0b-387f42eb7c3e tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.161620 Jun 16 17:43:37.050028 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 525/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:36 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:38.064061 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:38.064980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell0:SELECT=8 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:38.069667 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:38.071687 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:38.080570 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:38.081074 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:38.081897 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:38.082370 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:38.107152 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2017246573"}} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:38.108803 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:38.111591 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:38.117350 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:38.117892 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:38.118750 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:38.119258 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:38.306095 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:38.314575 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-853f104c-5e2f-45c6-a9a9-5aed8a9f25a3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1319 microversion: 2.1 time: 0.251837 Jun 16 17:43:38.315154 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 534/1059] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:38 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:38.318545 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.network.security_group_api [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Removing security group 67e9b173-e555-499a-87e1-4b1ac2b90b4e from port 847dc5cf-0312-4fdf-b298-3e5d0e5ddbca Jun 16 17:43:38.685254 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-484b11d5-eee7-46ae-aa96-8060646b8f8f tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action" status: 202 len: 0 microversion: 2.1 time: 0.582409 Jun 16 17:43:38.686401 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 526/1060] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jun 16 17:43:38 2022] POST /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 17:43:38.698885 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-ed9cecd3-b8f2-45bf-b154-5d2d61ecd586 req-2a6f3f35-650b-4697-bd6e-8ba54f9130dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:38.719449 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-ed9cecd3-b8f2-45bf-b154-5d2d61ecd586 req-2a6f3f35-650b-4697-bd6e-8ba54f9130dc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:38.721092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-ed9cecd3-b8f2-45bf-b154-5d2d61ecd586 req-2a6f3f35-650b-4697-bd6e-8ba54f9130dc service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:38.742449 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-ed9cecd3-b8f2-45bf-b154-5d2d61ecd586 req-2a6f3f35-650b-4697-bd6e-8ba54f9130dc service nova] Creating event network-changed:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:43:38.748872 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-ed9cecd3-b8f2-45bf-b154-5d2d61ecd586 req-2a6f3f35-650b-4697-bd6e-8ba54f9130dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057872 Jun 16 17:43:38.749833 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 535/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:39.331975 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:39.332708 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:39.339264 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:39.339711 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:39.340554 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:39.341058 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:39.951991 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:39.959600 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b6b46827-7d6b-4769-a10b-b54813b8e400 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1508 microversion: 2.1 time: 0.632062 Jun 16 17:43:39.960177 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 527/1062] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:39 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:39.977937 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed0192c8-5af6-454a-aeb2-7db9d24e3366", "device": "/dev/sdb"}} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:39.979141 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:39.982289 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:39.987386 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:39.988186 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:39.989247 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:39.989907 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.291208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-7121e72b-d413-4ee8-8829-91f9a2bd6f9a tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "POST /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318504 Jun 16 17:43:40.291851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 536/1063] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jun 16 17:43:39 2022] POST /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:40.584416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:40.585010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:40.593544 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:40.594389 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.595239 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:40.595681 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.697982 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lazy-loading 'services' on Instance uuid d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:43:40.774189 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-566dd149-b21e-44da-b272-3010d16b5191 req-e1bec465-1754-47c8-a590-ca7be5a3dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:40.796092 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-566dd149-b21e-44da-b272-3010d16b5191 req-e1bec465-1754-47c8-a590-ca7be5a3dd9c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:40.797038 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-566dd149-b21e-44da-b272-3010d16b5191 req-e1bec465-1754-47c8-a590-ca7be5a3dd9c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.820040 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-566dd149-b21e-44da-b272-3010d16b5191 req-e1bec465-1754-47c8-a590-ca7be5a3dd9c service nova] Creating event network-changed:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:43:40.823951 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-515680a4-ce1b-468e-9fe0-911b3d13bd32 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments/a22cd843-69ff-44cb-b7b1-59efa042cf9d" status: 202 len: 0 microversion: 2.1 time: 0.243461 Jun 16 17:43:40.828641 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 528/1064] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:43:40 2022] DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments/a22cd843-69ff-44cb-b7b1-59efa042cf9d => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:43:40.830516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-566dd149-b21e-44da-b272-3010d16b5191 req-e1bec465-1754-47c8-a590-ca7be5a3dd9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064693 Jun 16 17:43:40.832148 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 537/1065] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:43:40.839351 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:40.840745 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:40.848003 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:40.848547 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.849643 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:40.850081 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:40.893949 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-d696e1d7-e9db-403a-8e62-e790cb16d385 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063384 Jun 16 17:43:40.895655 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 529/1066] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:40 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:41.908845 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:41.909844 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:41.917473 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:41.918431 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:41.919297 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:41.919734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:41.956112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-18e3e58d-7fb3-4f1e-a84f-f452e2601d9c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052067 Jun 16 17:43:41.956710 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 538/1067] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:41 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:42.969302 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:42.970247 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:42.977330 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:42.977781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:42.978562 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:42.978997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:43.010864 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-9c5e9447-a74e-4bf8-8400-eb76b1ff2168 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Jun 16 17:43:43.011455 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 530/1068] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:42 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:44.023256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:44.024190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:44.031712 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:44.032161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:44.032934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:44.033413 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:44.066693 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2fed709d-f567-4b73-9206-f7ac0b0d95b1 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Jun 16 17:43:44.067276 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 539/1069] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:44 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:45.080359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:45.081357 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:45.088317 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:45.088772 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:45.089671 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:45.090783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:45.123889 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-bc71219d-fbea-4749-a8fc-cbd887958e03 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Jun 16 17:43:45.124462 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 531/1070] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:45 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:46.135540 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:46.136618 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:46.143539 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:46.143991 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:46.144756 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:46.145248 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:46.176205 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-54fb2d14-5d51-4eae-8aae-d84f081e6a76 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Jun 16 17:43:46.176792 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 540/1071] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:46 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:47.187692 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:47.188610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:47.195490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:47.195948 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:47.196687 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:47.197111 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:47.226703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-f66ad685-dec6-410d-96a3-9daa214c6f35 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043132 Jun 16 17:43:47.227267 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 532/1072] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:47 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:43:48.239922 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:48.240918 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:48.252109 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:48.252846 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:48.254161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:48.254734 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:48.291755 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-d0c221ca-f9c6-4301-9836-680f5b4a7a77 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055938 Jun 16 17:43:48.292352 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 541/1073] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jun 16 17:43:48 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 17:43:48.302703 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:48.303304 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:48.312086 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:48.312535 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:48.313352 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:48.313782 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:48.415090 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] HTTP exception thrown: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 is not attached to volume a22cd843-69ff-44cb-b7b1-59efa042cf9d Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Request method failure captured: Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments/a22cd843-69ff-44cb-b7b1-59efa042cf9d HTTP/1.1 Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2skNBpHurfSrA6YRSnhHz12jJoQ0DKP7tCqM4RoPzCgmaLpKe1YYWcvGiwKaOAUq9cDA8_jIAlV4YMGampK8khRI0NxDc-BUXRV6J89-lJ1ynmJwzBk1pWC-3ycSGDY_eeaybKuyyxQEOoYdalh-35BL7UDYqJj3VsKb43P5U_5mKk Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: ad7c8fc06d764104b1c7107b48d8dddc Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:43:48.424007 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad7c8fc06d764104b1c7107b48d8dddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad7c8fc06d764104b1c7107b48d8dddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ad7c8fc06d764104b1c7107b48d8dddc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ad7c8fc06d764104b1c7107b48d8dddc"}]}] Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: ad7c8fc06d764104b1c7107b48d8dddc Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-TestMinimumBasicScenario-866547470-project Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: af7be60f65da43f982c1ec2e91397051 Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-TestMinimumBasicScenario-866547470-project Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:43:48.426859 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 is not attached to volume a22cd843-69ff-44cb-b7b1-59efa042cf9d Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'server_id': 'd4c247cb-d14e-4c48-b6ec-9dd53c2f7020', 'id': 'a22cd843-69ff-44cb-b7b1-59efa042cf9d'} Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a22cd843-69ff-44cb-b7b1-59efa042cf9d. Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:43:48.428395 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 is not attached to volume a22cd843-69ff-44cb-b7b1-59efa042cf9d Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 is not attached to volume a22cd843-69ff-44cb-b7b1-59efa042cf9d Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:48.430858 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Returning 404 to user: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 is not attached to volume a22cd843-69ff-44cb-b7b1-59efa042cf9d {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:43:48.433008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e6490b32-eaa5-4313-8901-9e039782cd8c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments/a22cd843-69ff-44cb-b7b1-59efa042cf9d" status: 404 len: 154 microversion: 2.1 time: 0.127017 Jun 16 17:43:48.433008 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 533/1074] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:43:48 2022] DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020/os-volume_attachments/a22cd843-69ff-44cb-b7b1-59efa042cf9d => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:43:51.699178 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:51.699685 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:51.706053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:51.706497 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:51.707245 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:51.707674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:51.732802 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:43:51.812107 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-13c13c4a-a2fc-4b38-b5d9-49afbaf576cd tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 204 len: 0 microversion: 2.1 time: 0.116523 Jun 16 17:43:51.812873 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 542/1075] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:43:51 2022] DELETE /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:43:51.821175 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:51.821813 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:51.828778 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:51.829302 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:51.830089 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:51.830528 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:51.977018 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:51.990816 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-0fcc6fc5-c760-4756-9420-5df01662370b tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1554 microversion: 2.1 time: 0.173087 Jun 16 17:43:51.991740 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 534/1076] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:51 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:53.009420 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:53.010124 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:53.017871 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:53.018321 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:53.019091 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:53.019528 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:53.175894 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:53.184777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9993c487-149f-4459-ad31-a539c3281339 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1554 microversion: 2.1 time: 0.180357 Jun 16 17:43:53.185390 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 543/1077] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:53 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:54.208233 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:54.208820 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:54.215298 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:54.215734 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:54.216493 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:54.216924 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:54.353159 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:54.361407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-b34af63b-4f0d-4e6f-b613-1531d9bd515d tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1554 microversion: 2.1 time: 0.157187 Jun 16 17:43:54.362072 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 535/1078] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:54 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:55.380408 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:55.381090 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:55.388870 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:55.389354 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:55.390399 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:55.390809 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:55.539000 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:55.547112 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-98fae688-1c40-4b84-b197-4ac5b50d841c tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1554 microversion: 2.1 time: 0.171370 Jun 16 17:43:55.550565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 544/1079] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:55 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:56.258035 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-1c3b85c2-19c9-48d7-a1e8-029525846e5d req-42adb8a0-52ee-4ca3-9add-230637458907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c247cb-d14e-4c48-b6ec-9dd53c2f7020", "name": "network-vif-deleted", "tag": "847dc5cf-0312-4fdf-b298-3e5d0e5ddbca"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:43:56.268881 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-1c3b85c2-19c9-48d7-a1e8-029525846e5d req-42adb8a0-52ee-4ca3-9add-230637458907 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:56.269359 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-1c3b85c2-19c9-48d7-a1e8-029525846e5d req-42adb8a0-52ee-4ca3-9add-230637458907 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:56.282475 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-1c3b85c2-19c9-48d7-a1e8-029525846e5d req-42adb8a0-52ee-4ca3-9add-230637458907 service nova] Creating event network-vif-deleted:847dc5cf-0312-4fdf-b298-3e5d0e5ddbca for instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 on hv-cinder-83754 Jun 16 17:43:56.287976 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-1c3b85c2-19c9-48d7-a1e8-029525846e5d req-42adb8a0-52ee-4ca3-9add-230637458907 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Jun 16 17:43:56.288798 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 536/1080] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:43:56.564958 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:56.566672 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:56.574730 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:56.575144 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:56.575934 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:56.576380 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:56.615941 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:56.616721 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:56.617209 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lazy-loading 'fault' on Instance uuid d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:43:56.679882 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7be60f65da43f982c1ec2e91397051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7c8fc06d764104b1c7107b48d8dddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:43:56.691366 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-ce9c0706-17b1-4524-b535-ea7d9b867c95 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 200 len: 1348 microversion: 2.1 time: 0.130172 Jun 16 17:43:56.692027 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 545/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:56 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 1348 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:43:57.718342 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.719045 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] [instance: d4c247cb-d14e-4c48-b6ec-9dd53c2f7020] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:57.725691 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:57.726136 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:57.726904 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:57.727374 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:57.740997 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] HTTP exception thrown: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Request method failure captured: Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 HTTP/1.1 Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2skNBpHurfSrA6YRSnhHz12jJoQ0DKP7tCqM4RoPzCgmaLpKe1YYWcvGiwKaOAUq9cDA8_jIAlV4YMGampK8khRI0NxDc-BUXRV6J89-lJ1ynmJwzBk1pWC-3ycSGDY_eeaybKuyyxQEOoYdalh-35BL7UDYqJj3VsKb43P5U_5mKk Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: ad7c8fc06d764104b1c7107b48d8dddc Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:43:57.742783 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad7c8fc06d764104b1c7107b48d8dddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad7c8fc06d764104b1c7107b48d8dddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ad7c8fc06d764104b1c7107b48d8dddc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ad7c8fc06d764104b1c7107b48d8dddc"}]}] Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: ad7c8fc06d764104b1c7107b48d8dddc Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-TestMinimumBasicScenario-866547470 Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-TestMinimumBasicScenario-866547470-project Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: af7be60f65da43f982c1ec2e91397051 Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-TestMinimumBasicScenario-866547470-project Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. Jun 16 17:43:57.744315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': 'd4c247cb-d14e-4c48-b6ec-9dd53c2f7020'} Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:43:57.745134 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. Jun 16 17:43:57.746732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:43:57.747998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Returning 404 to user: Instance d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:43:57.747998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-98d7d7f8-9f10-4267-8101-9c9ab2be8261 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020" status: 404 len: 111 microversion: 2.1 time: 0.032082 Jun 16 17:43:57.747998 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 537/1082] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:43:57 2022] GET /compute/v2.1/servers/d4c247cb-d14e-4c48-b6ec-9dd53c2f7020 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:43:57.754432 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1642dd3f-6cc0-4c45-a9d7-44a4ff9eb014 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] Calling method '.version_select at 0x7f84aa4ddca0>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:57.773516 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1642dd3f-6cc0-4c45-a9d7-44a4ff9eb014 tempest-TestMinimumBasicScenario-866547470 tempest-TestMinimumBasicScenario-866547470-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1089942978" status: 202 len: 0 microversion: 2.1 time: 0.023557 Jun 16 17:43:57.774229 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 546/1083] 10.222.0.40 () {58 vars in 1271 bytes} [Thu Jun 16 17:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1089942978 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:43:59.782179 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:43:59.782754 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:43:59.790569 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:59.791023 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:59.792412 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:43:59.792855 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:43:59.796050 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:43:59.891066 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.objects.instance [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lazy-loading 'services' on Instance uuid 86d0846b-c4b5-4931-8752-4a71919b4b78 {{(pid=124160) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:43:59.983249 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-5d3b1eba-6b13-48ca-8cf7-06dfae03184b tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "DELETE /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78/os-volume_attachments/ed0192c8-5af6-454a-aeb2-7db9d24e3366" status: 202 len: 0 microversion: 2.1 time: 0.204978 Jun 16 17:43:59.987231 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 538/1084] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jun 16 17:43:59 2022] DELETE /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78/os-volume_attachments/ed0192c8-5af6-454a-aeb2-7db9d24e3366 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:44:01.137498 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:01.138053 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:01.145685 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:01.146440 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:01.147241 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:01.147682 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:01.169096 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:01.178429 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:44:01.295256 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9b811b6d-acda-464c-bedb-ee06a2d863e7 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "DELETE /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 204 len: 0 microversion: 2.1 time: 0.162558 Jun 16 17:44:01.297790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 547/1085] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:44:01 2022] DELETE /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:44:01.306945 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:01.308610 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:01.315544 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:01.316297 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:01.317405 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:01.318049 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:01.515094 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:01.530269 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c09fdd72-207d-4e5e-b2b7-c43076d3ada6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1514 microversion: 2.1 time: 0.227777 Jun 16 17:44:01.531076 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 539/1086] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:01 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:44:02.549205 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:02.549926 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:02.561641 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:02.562251 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:02.563427 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:02.563904 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:02.707663 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:02.720534 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-69230aab-fe60-455c-be48-02f5d1ce7504 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1514 microversion: 2.1 time: 0.175972 Jun 16 17:44:02.721333 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 548/1087] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:02 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:03.573470 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-822a3fa3-73ee-45d6-b1dc-c9129c3a6b3b req-cf0be594-c4b5-4f7b-8c0a-ad0e75801c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d0846b-c4b5-4931-8752-4a71919b4b78", "name": "network-vif-deleted", "tag": "99ed25c1-10d3-4534-bc18-a08b9bb5025c"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:03.588490 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-822a3fa3-73ee-45d6-b1dc-c9129c3a6b3b req-cf0be594-c4b5-4f7b-8c0a-ad0e75801c4c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:03.589407 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-822a3fa3-73ee-45d6-b1dc-c9129c3a6b3b req-cf0be594-c4b5-4f7b-8c0a-ad0e75801c4c service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:03.606444 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-822a3fa3-73ee-45d6-b1dc-c9129c3a6b3b req-cf0be594-c4b5-4f7b-8c0a-ad0e75801c4c service nova] Creating event network-vif-deleted:99ed25c1-10d3-4534-bc18-a08b9bb5025c for instance 86d0846b-c4b5-4931-8752-4a71919b4b78 on hv-cinder-83754 Jun 16 17:44:03.613851 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-822a3fa3-73ee-45d6-b1dc-c9129c3a6b3b req-cf0be594-c4b5-4f7b-8c0a-ad0e75801c4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056685 Jun 16 17:44:03.615465 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 540/1088] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:03.743083 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:03.744303 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:03.757797 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:03.758284 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:03.759777 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:03.762450 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:03.824836 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:03.829643 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:03.830479 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.objects.instance [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lazy-loading 'fault' on Instance uuid 86d0846b-c4b5-4931-8752-4a71919b4b78 {{(pid=124161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 17:44:03.882653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de9e460242c4a02ad28af485ad851e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554c281060a446ed9b2d02bad7b8ec1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:03.902851 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1a031312-88f3-443c-af9c-fb4a9700f6c3 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 200 len: 1309 microversion: 2.1 time: 0.166704 Jun 16 17:44:03.904175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 549/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:03 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:04.922964 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:04.923819 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] [instance: 86d0846b-c4b5-4931-8752-4a71919b4b78] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:04.932173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:04.932173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:04.932173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:04.932173 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:04.958363 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] HTTP exception thrown: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Request method failure captured: Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 HTTP/1.1 Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2timO4JWqh1F_Ux4ty_-Rlm0HbgfiwEot_z7YwWz4fo5qwgdAauGo0b9qRg_7z3jtWIwjb2D0NFyYkNcb79qQhxIVbOW9D3KmWbe6rpbmrZGPFpbP7-Gxt8ljNRZQ0673apsIGm4grfKev2ELmctWE2bt0PthfuJX-eFyNyFB15Mzs Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 554c281060a446ed9b2d02bad7b8ec1d Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:44:04.960010 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/554c281060a446ed9b2d02bad7b8ec1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/554c281060a446ed9b2d02bad7b8ec1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_554c281060a446ed9b2d02bad7b8ec1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/554c281060a446ed9b2d02bad7b8ec1d"}]}] Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 554c281060a446ed9b2d02bad7b8ec1d Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1672951330 Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-VolumesSnapshotTestJSON-1672951330-project Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: 9de9e460242c4a02ad28af485ad851e5 Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-VolumesSnapshotTestJSON-1672951330-project Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. Jun 16 17:44:04.961781 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '86d0846b-c4b5-4931-8752-4a71919b4b78'} Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:44:04.962617 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. Jun 16 17:44:04.965130 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:04.966799 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] Returning 404 to user: Instance 86d0846b-c4b5-4931-8752-4a71919b4b78 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:44:04.966799 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-c9db2d15-99cd-432d-aaa0-43f0210c18c6 tempest-VolumesSnapshotTestJSON-1672951330 tempest-VolumesSnapshotTestJSON-1672951330-project] 10.222.0.40 "GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78" status: 404 len: 111 microversion: 2.1 time: 0.043345 Jun 16 17:44:04.970156 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 541/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:04 2022] GET /compute/v2.1/servers/86d0846b-c4b5-4931-8752-4a71919b4b78 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:44:26.586005 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-0c3d5ca1-08ee-4ea7-be4d-5689991d2224 req-ce54179b-3f55-4771-b2c5-0596204d8de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880f65f6-c574-48a5-8868-6979fc8a834a", "tag": "6c5ca3a5-989e-4775-9839-4980ee405ae9"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:26.591137 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_api:SELECT=31 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.591629 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.592146 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.594414 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG dbcounter [-] [124160] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=124160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.595585 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.596261 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG dbcounter [-] [124161] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:44:26.604773 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-0c3d5ca1-08ee-4ea7-be4d-5689991d2224 req-ce54179b-3f55-4771-b2c5-0596204d8de3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.605092 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-0c3d5ca1-08ee-4ea7-be4d-5689991d2224 req-ce54179b-3f55-4771-b2c5-0596204d8de3 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.607983 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.608437 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.609263 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.609861 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.617566 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-0c3d5ca1-08ee-4ea7-be4d-5689991d2224 req-ce54179b-3f55-4771-b2c5-0596204d8de3 service nova] Creating event network-changed:6c5ca3a5-989e-4775-9839-4980ee405ae9 for instance 880f65f6-c574-48a5-8868-6979fc8a834a on hv-cinder-83754 Jun 16 17:44:26.622683 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-0c3d5ca1-08ee-4ea7-be4d-5689991d2224 req-ce54179b-3f55-4771-b2c5-0596204d8de3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Jun 16 17:44:26.623268 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 542/1091] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:26.640190 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Going to try to terminate instance {{(pid=124161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:44:26.734974 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-756ade87-0ac6-48fa-bec3-ee6a940ef421 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "DELETE /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 204 len: 0 microversion: 2.1 time: 0.147584 Jun 16 17:44:26.736193 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 550/1092] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:44:26 2022] DELETE /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:44:26.745810 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:26.746574 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:26.753840 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.754358 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:26.755435 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:26.755955 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:27.183906 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:27.191837 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-1e86b176-9469-4358-aab6-f427be675354 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1577 microversion: 2.1 time: 0.450727 Jun 16 17:44:27.192419 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 543/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:26 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1577 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:28.210617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:28.210617 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:28.217840 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.218290 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.219060 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.219498 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.506208 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:28.514811 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-57445ee9-05e3-4c81-8a44-d84eeedbbf1b tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 200 len: 1577 microversion: 2.1 time: 0.309433 Jun 16 17:44:28.515515 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 551/1094] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:28 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 1577 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:28.881700 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [req-42ad6e28-95f5-4dc8-b59a-431f04194113 req-e838b555-1f01-4748-bd11-40ee70fc505d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880f65f6-c574-48a5-8868-6979fc8a834a", "name": "network-vif-deleted", "tag": "6c5ca3a5-989e-4775-9839-4980ee405ae9"}]} {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:28.892452 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-42ad6e28-95f5-4dc8-b59a-431f04194113 req-e838b555-1f01-4748-bd11-40ee70fc505d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:28.892898 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [req-42ad6e28-95f5-4dc8-b59a-431f04194113 req-e838b555-1f01-4748-bd11-40ee70fc505d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:28.906741 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.compute.server_external_events [req-42ad6e28-95f5-4dc8-b59a-431f04194113 req-e838b555-1f01-4748-bd11-40ee70fc505d service nova] Creating event network-vif-deleted:6c5ca3a5-989e-4775-9839-4980ee405ae9 for instance 880f65f6-c574-48a5-8868-6979fc8a834a on hv-cinder-83754 Jun 16 17:44:28.912971 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [req-42ad6e28-95f5-4dc8-b59a-431f04194113 req-e838b555-1f01-4748-bd11-40ee70fc505d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034707 Jun 16 17:44:28.913839 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 544/1095] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:29.540426 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:29.542308 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 880f65f6-c574-48a5-8868-6979fc8a834a] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:29.551282 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.551930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.552979 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:29.553949 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:29.573888 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] HTTP exception thrown: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Request method failure captured: Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a HTTP/1.1 Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2oksHa67tve_fkb2iUG37eFBFJ18UlQslPqeTUfBskRS-e9p8WKN_vE2XSl0-Z3HkrC52eAV8_FUOCKzqAI25K5Ip-lQvLIC4cQ5EWO61JHochP3da5iACLfKbfc_MQxXQ89rTkpqtqHtkug4PM-cN0Ety-j3DRpd9aM2EXjeQij0w Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:44:29.575565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_314e9434e0ec4c1f9e8d6037143f5ebb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/314e9434e0ec4c1f9e8d6037143f5ebb"}]}] Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: faf0a0102da24cedaedd0c67273e275b Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. Jun 16 17:44:29.577128 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '880f65f6-c574-48a5-8868-6979fc8a834a'} Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:44:29.578030 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. Jun 16 17:44:29.579668 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:29.580910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Returning 404 to user: Instance 880f65f6-c574-48a5-8868-6979fc8a834a could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:44:29.580910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-1282c2b9-2987-4d41-9fa4-5fde4bd04df4 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a" status: 404 len: 111 microversion: 2.1 time: 0.046031 Jun 16 17:44:29.580910 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 552/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:29 2022] GET /compute/v2.1/servers/880f65f6-c574-48a5-8868-6979fc8a834a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:44:30.270416 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:44:30.271033 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Thu Jun 16 17:44:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:44:32.710308 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:32.710938 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-8019a08b-748e-4e63-b01f-ef5beb33a911 req-9b72a608-b664-46f3-8471-db20283e836d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e064158b-7b81-42c1-bc01-057812cdcb57", "tag": "cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:32.711326 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:32.719402 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.720128 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.720907 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.721386 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.722199 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-8019a08b-748e-4e63-b01f-ef5beb33a911 req-9b72a608-b664-46f3-8471-db20283e836d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.722653 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-8019a08b-748e-4e63-b01f-ef5beb33a911 req-9b72a608-b664-46f3-8471-db20283e836d service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.737216 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-8019a08b-748e-4e63-b01f-ef5beb33a911 req-9b72a608-b664-46f3-8471-db20283e836d service nova] Creating event network-changed:cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e for instance e064158b-7b81-42c1-bc01-057812cdcb57 on hv-cinder-83754 Jun 16 17:44:32.742790 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-8019a08b-748e-4e63-b01f-ef5beb33a911 req-9b72a608-b664-46f3-8471-db20283e836d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035389 Jun 16 17:44:32.744223 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 553/1097] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 17:44:32.749588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Going to try to terminate instance {{(pid=124160) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 17:44:32.841331 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-3f6ab60f-b91e-47a9-82bb-af615b574ccf tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 204 len: 0 microversion: 2.1 time: 0.135542 Jun 16 17:44:32.842232 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 545/1098] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:44:32 2022] DELETE /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 17:44:32.860133 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:32.860841 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:32.867336 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.867788 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:32.868565 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:32.869745 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:33.024388 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.policy [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:33.032980 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-2897c4d2-e609-43d7-92eb-bd7db7c5b0e7 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1575 microversion: 2.1 time: 0.179571 Jun 16 17:44:33.033597 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 554/1099] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:32 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:34.050857 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:34.051557 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:34.059012 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.059457 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.060258 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:34.060694 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:34.293315 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:34.301437 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-13c8a829-a2f1-4c81-beec-33df6d14b6b1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1575 microversion: 2.1 time: 0.254668 Jun 16 17:44:34.302187 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 546/1100] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:34 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:35.215393 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [req-b944fb30-fbbb-4987-9a13-8419fb0c9732 req-0be044d0-a503-48d6-8931-4891bfb40ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e064158b-7b81-42c1-bc01-057812cdcb57", "name": "network-vif-deleted", "tag": "cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e"}]} {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:44:35.226047 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b944fb30-fbbb-4987-9a13-8419fb0c9732 req-0be044d0-a503-48d6-8931-4891bfb40ee9 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.226741 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [req-b944fb30-fbbb-4987-9a13-8419fb0c9732 req-0be044d0-a503-48d6-8931-4891bfb40ee9 service nova] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.241492 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.compute.server_external_events [req-b944fb30-fbbb-4987-9a13-8419fb0c9732 req-0be044d0-a503-48d6-8931-4891bfb40ee9 service nova] Creating event network-vif-deleted:cc7803f8-e7cb-4bb7-a65a-f2c6bd3a1b8e for instance e064158b-7b81-42c1-bc01-057812cdcb57 on hv-cinder-83754 Jun 16 17:44:35.247981 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [req-b944fb30-fbbb-4987-9a13-8419fb0c9732 req-0be044d0-a503-48d6-8931-4891bfb40ee9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Jun 16 17:44:35.248623 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 555/1101] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jun 16 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:44:35.319237 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:35.319848 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:35.327588 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.328039 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.328806 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:35.329284 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:35.397578 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.policy [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf0a0102da24cedaedd0c67273e275b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314e9434e0ec4c1f9e8d6037143f5ebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124160) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 17:44:35.406024 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-49a2dc01-f1ac-4f44-a78b-0f7c47e6f05d tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 200 len: 1224 microversion: 2.1 time: 0.090564 Jun 16 17:44:35.406732 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 547/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:35 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:44:36.424674 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.425430 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: e064158b-7b81-42c1-bc01-057812cdcb57] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.431961 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.432401 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.433171 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.434682 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.450249 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] HTTP exception thrown: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Request method failure captured: Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 HTTP/1.1 Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2oksHa67tve_fkb2iUG37eFBFJ18UlQslPqeTUfBskRS-e9p8WKN_vE2XSl0-Z3HkrC52eAV8_FUOCKzqAI25K5Ip-lQvLIC4cQ5EWO61JHochP3da5iACLfKbfc_MQxXQ89rTkpqtqHtkug4PM-cN0Ety-j3DRpd9aM2EXjeQij0w Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:44:36.451914 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_314e9434e0ec4c1f9e8d6037143f5ebb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/314e9434e0ec4c1f9e8d6037143f5ebb"}]}] Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: faf0a0102da24cedaedd0c67273e275b Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. Jun 16 17:44:36.453766 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': 'e064158b-7b81-42c1-bc01-057812cdcb57'} Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:44:36.454678 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. Jun 16 17:44:36.456305 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.458161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Returning 404 to user: Instance e064158b-7b81-42c1-bc01-057812cdcb57 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:44:36.458161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-9a7a2e62-9902-439e-bcda-b30c7a4acc26 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57" status: 404 len: 111 microversion: 2.1 time: 0.033537 Jun 16 17:44:36.458161 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 556/1103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:36 2022] GET /compute/v2.1/servers/e064158b-7b81-42c1-bc01-057812cdcb57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:44:36.920110 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.920737 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.compute.api [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124160) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.927286 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.927735 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.928512 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.928965 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG oslo_concurrency.lockutils [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.943124 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.wsgi [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] HTTP exception thrown: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Request method failure captured: Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: request: DELETE /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 HTTP/1.1 Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept: application/json Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Accept-Encoding: identity Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Connection: close Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Length: 0 Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Content-Type: application/json Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Host: 10.222.0.40 Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Openstack-System-Scope: None Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: User-Agent: python-urllib3/1.26.9 Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Auth-Token: gAAAAABiq2oksHa67tve_fkb2iUG37eFBFJ18UlQslPqeTUfBskRS-e9p8WKN_vE2XSl0-Z3HkrC52eAV8_FUOCKzqAI25K5Ip-lQvLIC4cQ5EWO61JHochP3da5iACLfKbfc_MQxXQ89rTkpqtqHtkug4PM-cN0Ety-j3DRpd9aM2EXjeQij0w Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Id: None Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Domain-Name: None Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Identity-Status: Confirmed Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Is-Admin-Project: True Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Id: default Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Domain-Name: Default Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Project-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Role: member,reader Jun 16 17:44:36.944791 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Roles: member,reader Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_314e9434e0ec4c1f9e8d6037143f5ebb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/314e9434e0ec4c1f9e8d6037143f5ebb"}]}] Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Id: default Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Domain-Name: Default Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Id: faf0a0102da24cedaedd0c67273e275b Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: X-User-Name: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: method: > Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: exception: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.946575 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: action_args: {'id': '8d39f223-c8ed-4c3c-a006-fe3698711485'} Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:44:36.947985 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.949443 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.950785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Returning 404 to user: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. {{(pid=124160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:44:36.950785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-2929b3e7-834f-4f22-b51e-ac23a280ede1 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 404 len: 111 microversion: 2.1 time: 0.030164 Jun 16 17:44:36.950785 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 548/1104] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jun 16 17:44:36 2022] DELETE /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:44:36.955796 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '>' {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:36.956446 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.compute.api [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] [instance: 8d39f223-c8ed-4c3c-a006-fe3698711485] Fetching instance by UUID {{(pid=124161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 17:44:36.962575 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.963167 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.963930 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:44:36.964360 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG oslo_concurrency.lockutils [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Lock "62ae26bd-3c1e-469b-8e56-1cd9277abf92" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:44:36.978331 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.wsgi [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] HTTP exception thrown: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Request method failure captured: Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: request: GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 HTTP/1.1 Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept: application/json Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Accept-Encoding: identity Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Connection: close Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Length: 0 Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Content-Type: application/json Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Host: 10.222.0.40 Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Openstack-System-Scope: None Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: User-Agent: python-urllib3/1.26.9 Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Auth-Token: gAAAAABiq2oksHa67tve_fkb2iUG37eFBFJ18UlQslPqeTUfBskRS-e9p8WKN_vE2XSl0-Z3HkrC52eAV8_FUOCKzqAI25K5Ip-lQvLIC4cQ5EWO61JHochP3da5iACLfKbfc_MQxXQ89rTkpqtqHtkug4PM-cN0Ety-j3DRpd9aM2EXjeQij0w Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Id: None Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Domain-Name: None Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Identity-Status: Confirmed Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Is-Admin-Project: True Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Id: default Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Domain-Name: Default Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Project-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Role: member,reader Jun 16 17:44:36.979868 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Roles: member,reader Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/314e9434e0ec4c1f9e8d6037143f5ebb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_314e9434e0ec4c1f9e8d6037143f5ebb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/314e9434e0ec4c1f9e8d6037143f5ebb"}]}] Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Id: 314e9434e0ec4c1f9e8d6037143f5ebb Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1402985346 Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Id: default Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Domain-Name: Default Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Id: faf0a0102da24cedaedd0c67273e275b Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: X-User-Name: tempest-TestVolumeBootPattern-1402985346-project Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: method: > Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: exception: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.981612 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: action_args: {'id': '8d39f223-c8ed-4c3c-a006-fe3698711485'} Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: {{(pid=124161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:44:36.982549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. Jun 16 17:44:36.984085 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: ERROR nova.api.openstack.wsgi Jun 16 17:44:36.985549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: DEBUG nova.api.openstack.wsgi [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Returning 404 to user: Instance 8d39f223-c8ed-4c3c-a006-fe3698711485 could not be found. {{(pid=124161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:44:36.985549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO nova.api.openstack.requestlog [None req-40215267-8ad9-4696-a4d7-5c356e099a21 tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485" status: 404 len: 111 microversion: 2.1 time: 0.029305 Jun 16 17:44:36.985549 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: [pid: 124161|app: 0|req: 557/1105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jun 16 17:44:36 2022] GET /compute/v2.1/servers/8d39f223-c8ed-4c3c-a006-fe3698711485 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 17:44:38.290340 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: DEBUG nova.api.openstack.wsgi [None req-e2ff0799-260d-4c13-858a-d20d92f16a1f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] Calling method '.version_select at 0x7f84aa7cab80>' {{(pid=124160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:44:38.316505 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO nova.api.openstack.requestlog [None req-e2ff0799-260d-4c13-858a-d20d92f16a1f tempest-TestVolumeBootPattern-1402985346 tempest-TestVolumeBootPattern-1402985346-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-489756062" status: 202 len: 0 microversion: 2.1 time: 0.029871 Jun 16 17:44:38.317814 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: [pid: 124160|app: 0|req: 549/1106] 10.222.0.40 () {58 vars in 1259 bytes} [Thu Jun 16 17:44:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-489756062 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 17:46:07.814085 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:46:07.814827 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Thu Jun 16 17:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:46:08.485713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:46:08.486221 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Thu Jun 16 17:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:47:50.280399 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:47:50.281059 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Thu Jun 16 17:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:49:27.823151 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:49:27.823937 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Thu Jun 16 17:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:49:28.494239 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:49:28.494835 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Thu Jun 16 17:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:49:31.687512 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:49:31.688175 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Thu Jun 16 17:49:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:49:45.832864 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:49:45.833713 dv-cinder-837546-2-iscsi devstack@n-api.service[124161]: Thu Jun 16 17:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:49:51.957529 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:49:51.958166 dv-cinder-837546-2-iscsi devstack@n-api.service[124160]: Thu Jun 16 17:49:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!